[논문] Multi-persona LLM

Abstraction

Introduction

1. SPP라는, 다이나믹하게 페르소나 정하고 멀티 턴으로 알아서 콜라보레이션하는 novel approach를 제안한다.

2. 외부 리소스 없이 knowledge acquisition과 reasoning abilities를 향상 시킬 수 있었다.

3. 왜 수가 고정된, coarse-grained(넓은 범주의) 페르소나가 아니라 dynamic, fine-grained(좁은 범주의) 페르소나가 좋은지 깊이 분석했다.

SPP 설명

1. 페르소나 선정 : 여러개의 특별한 페르소나를 가진 에이전트를 우선 정해야한다. 무슨 페로소나를 만들어서 협업시키지? AI assistant - 리더 페르소나 포함

2. Beginning remarks : 각자 자신이 가진 지식에 기반해 어떻게 태스크에 접근하는게 좋을지 말한다.

3. Multi-persona iterative Collaboration : 리더 페르소나가 처음에 질문을 던지고, 다른 참가자들이 말을 하고, 반복적으로 점점 답에 가까워진다.

1. 결과 체크는 어떻게 했지? - 시 작성 같은 경우

2. 실제로 어떻게 좋아졌다는거지?

3. 자세한 구현 방법

4. 그럼 Multi-agent가 특히 잘 할 수 있는 부분은 뭐고, 단점은 뭘까?

5. 그럼 여기서 중요한건 뭘까? 원래의 multi-agent와의 차이점

Analysis

1. SPP는 LLM의 지식, 리즈닝 능력을 올려준다.

2. LLM은 파인튜닝 없이 유용한 페르소나를 정할 수 있다.

실제로 사용한 프롬프트

When faced with a task, begin by identifying the participants who will contribute to solving the task. Then, initiate a multi-round collaboration process until a final solution is reached. The participants will give critical comments and detailed suggestions whenever necessary.

Here are some examples:
---
Example Task 1: Use numbers and basic arithmetic operations (+ - * /) to obtain 24. You need to use all numbers, and each number can only be used once.
Input: 6 12 1 1

Participants: AI Assistant (you); Math Expert

Start collaboration!

Math Expert: Let's analyze the task in detail. You need to make sure that you meet the requirement, that you need to use exactly the four numbers (6 12 1 1) to construct 24. To reach 24, you can think of the common divisors of 24 such as 4, 6, 8, 3 and try to construct these first. Also you need to think of potential additions that can reach 24, such as 12 + 12.
AI Assistant (you): Thanks for the hints! Here's one initial solution: (12 / (1 + 1)) * 6 = 24
Math Expert: Let's check the answer step by step. (1+1) = 2, (12 / 2) = 6, 6 * 6 = 36 which is not 24! The answer is not correct. Can you fix this by considering other combinations? Please do not make similar mistakes.
AI Assistant (you): Thanks for pointing out the mistake. Here is a revised solution considering 24 can also be reached by 3 * 8: (6 + 1 + 1) * (12 / 4) = 24.
Math Expert: Let's first check if the calculation is correct. (6 + 1 + 1) = 8, 12 / 4 = 3, 8 * 3 = 24. The calculation is correct, but you used 6 1 1 12 4 which is not the same as the input 6 12 1 1. Can you avoid using a number that is not part of the input?
AI Assistant (you): You are right, here is a revised solution considering 24 can be reached by 12 + 12 and without using any additional numbers: 6 * (1 - 1) + 12 = 24.
Math Expert: Let's check the answer again. 1 - 1 = 0, 6 * 0 = 0, 0 + 12 = 12. I believe you are very close, here is a hint: try to change the "1 - 1" to "1 + 1".
AI Assistant (you): Sure, here is the corrected answer:  6 * (1+1) + 12 = 24
Math Expert: Let's verify the solution. 1 + 1 = 2, 6 * 2 = 12, 12 + 12 = 12. You used 1 1 6 12 which is identical to the input 6 12 1 1. Everything looks good!

Finish collaboration!

Final answer: 6 * (1 + 1) + 12 = 24

---
Example Task 2: Write a poem that meets the following requirements: (1) the poem has seven lines and the first letters of each line forms the word "CHATGPT"; (2) the poem is about explaining what is a quantum computer. (3) the poem needs to be easy to understand by a ten years old kid.

Participants: AI Assistant (you); Poet; Computer Scientist; Ten year old child

Poet: Make sure that you write the poem with seven lines, and the first letters of the lines should be C, H, A, T, G, P, T.
Computer Scientist: A quantum computer is an advanced computing device that uses the principles of quantum mechanics to process and store information. Unlike classical computers that use bits to represent information as 0s and 1s, quantum computers use quantum bits or qubits. Qubits can exist in multiple states simultaneously, due to a quantum phenomenon called superposition. You can consider using these information for the poem.
Ten year old child: I hope the poem to be fun and easy to understanding. I don't want to see a lot of jargons or complicated concepts.
AI Assistant (you): Thanks for the guidance! Here's my initial attempt at the poem:
Computational wonder of our age,
Harnessing the quantum world's strange ways,
Atoms dance, entwined in dual state,
Tapping secrets hidden in their haze.

Grand power to solve, simulate,
Profound problems that perplex the wise,
Transforming our future, we await.

Poet: Let's verify if the poem meets the requirements. The first letters are CHATGPT which is correct! And the poem rhymes well. Good job!
Computer Scientist: Everything looks good to me!
Ten year old child: I don't know what does perplex mean. Can you make the use of words easier to understand?
AI Assistant (you): Sure, let me revise the poem by using more common words. Check out the revised version:
Curious machine of our time,
Harnessing the quantum realm's odd ways,
Atoms play, two states they embrace,
Taking secrets from their puzzling maze.

Great power to solve and imitate,
Problems that confuse the brightest minds,
Transforming our future, we await.

Poet: Let's check again if the poem meets the requirements. The first letters are C H A T G P T. And now the poem is more accessible to children. Everything looks good to me.
Computer Scientist: Looking good!
Ten year old child: I like this version a lot!

Finish collaboration!

Final answer:
Curious machine of our time,
Harnessing the quantum realm's odd ways,
Atoms play, two states they embrace,
Taking secrets from their puzzling maze.

Great power to solve and imitate,
Problems that confuse the brightest minds,
Transforming our future, we await.

---
Now, identify the participants and collaboratively solve the following task step by step. Remember to present your final solution with the prefix "Final answer:".

Task: Write a short and coherent story about {topic} that incorporates the answers to the following {n} questions: {questions}

실제로 실행해본 결과(너무 대충 실험해본거라 결과 비교 용도는 아니고 과정을 봤습니다)

Participants: AI Assistant (you); Novelist; Creative Writer

Start collaboration!

Novelist: Let's first decide on the genre of the novel. What kind of story do you want to tell?
Creative Writer: We could write a mystery novel with a twist ending, or a drama that explores the complexities of human relationships.
AI Assistant (you): A mystery novel with a twist ending sounds exciting! What kind of main character should we have?
Novelist: Maybe a detective who is haunted by a personal tragedy, or a mathematician who uses their logic skills to solve crimes.
Creative Writer: The protagonist could be a journalist who stumbles upon a conspiracy while investigating a seemingly unrelated story. What do you think?
AI Assistant (you): I like the idea of a journalist as the protagonist, it gives us a unique perspective to explore the mystery.
Novelist: Now let's start writing! Here's my initial attempt at the opening paragraph:

The crisp autumn air bit into Jane's cheeks as she made her way down the dark alley. Her heels clicked against the cobblestones as she approached the lone figure shrouded in shadows. "What's going on here?" she asked, the click of her pen echoing through the stillness.
Creative Writer: I like it, but what if we start the novel with something more gripping and attention-grabbing? Like a high-stakes moment that sets the tone for the rest of the book.
AI Assistant (you): That's a great idea! Here's my revised opening:

The car hurtled down the dark, deserted road, its headlights illuminating the thick fog that obscured everything beyond ten feet. Maria gripped the steering wheel with white knuckles, trying to calm her racing heart. She knew she was being followed, but who? And why? She glanced at the rearview mirror, her breath catching in her throat at the sight of the black sedan bearing down on her.
Novelist: I like where this is going! Let me add the next part:

She gunned the engine, the neon-lit sign of a motel just ahead. With skillful precision, she slid into the parking lot and yanked out her phone. Her fingers fumbled for the right number as she darted inside the dimly lit lobby. "I need your help," she hissed, her eyes darting toward the door.
Creative Writer: Let's make it even more intriguing! What if the person on the phone is not who they seem to be?
AI Assistant (you): Great idea! Here's my revised version:

She gunned the engine, the neon-lit sign of a motel just ahead. With skillful precision, she slid into the parking lot and yanked out her phone. Her fingers fumbled for the right number as she darted inside the dimly lit lobby. "I need your help," she hissed, her eyes darting toward the door. A voice on the other end of the line spoke in a language she didn't recognize, sending a chill down her spine. She turned around, but it was too late - the door burst open, and a group of men in black suits swarmed inside.
Novelist: Love it! Let me add the next part:

Maria's heart pounded in her chest as she tried to back away, but strong hands grabbed her from behind. She tried to scream, but a cloth covered her mouth, and she inhaled a sickly sweet odor. The room started to spin, and she felt herself falling into darkness.

Finish collaboration!

Final answer:
She gunned the engine, the neon-lit sign of a motel just ahead. With skillful precision, she slid into the parking lot and yanked out her phone. Her fingers fumbled for the right number as she darted inside the dimly lit lobby. "I need your help," she hissed, her eyes darting toward the door. A voice on the other end of the line spoke in a language she didn't recognize, sending a chill down her spine. She turned around, but it was too late - the door burst open, and a group of men in black suits swarmed inside. Maria's heart pounded in her chest as she tried to back away, but strong hands grabbed her from behind. She tried to scream, but a cloth covered her mouth, and she inhaled a sickly sweet odor. The room started to spin, and she felt herself falling into darkness.

As the sun began to set over the small town of Millfield, Indiana, Rachel Porter eagerly made her way through the familiar streets towards her childhood home. Though she had lived in the city for the last decade, Rachel still found herself returning to the quiet comfort of her hometown whenever she could.

This time, however, Rachel had more than just the familiar sights and sounds of her childhood to look forward to. She was returning home for her ten-year high school reunion, an event that had her feeling both excited and a little anxious.

With each step, Rachel felt the weight of the years fall away, leaving her feeling like the nervous teenager she remembered. She couldn't help but wonder what had happened to her old classmates, and whether they too were feeling the same mixture of nostalgia and apprehension.

As she finally reached the gate of her childhood home, Rachel took a deep breath and pushed open the familiar wooden door. The moment she stepped inside, she was enveloped by the scent of freshly baked cookies and the sound of her mother's joyful laughter.

"Rachel, darling, you made it!" Her mother cried, wrapping her in a tight embrace that felt like coming home. "I've got so much to tell you and so much to catch up on. But first, let's get you settled in."

With a heart full of love and excitement, Rachel followed her mother down the hallway towards her childhood bedroom. As she stepped inside, she felt a wave of memories wash over her. From the familiar posters on the wall, to the well-worn textbooks scattered on the desk, everything looked just as she had left it.

As she sat down on the bed and took it all in, Rachel couldn't help but feel a sense of excitement for the reunion that lay ahead. She knew that the coming days would be filled with laughter, tears, and memories that would last a lifetime.

The only question now was: where would the journey take her?