Smile AI Benchmark

I was building a Duolingo-inspired widget to show weekly progress/streak. Using Cursor.com with Claude 3.5 Sonnet, I got impressive results, including the idea of scaling happiness with emojis. This got me thinking: How would other LLMs deal with this task?

I asked various LLMs the following prompt:

I'm building a small tracker widget. It shows 7 days of a week and I can rate each day with emojis. Starting with a basic smile and scaling it up to 7 times with more smiled emoji. Create arrays with those 7 emojis scale.

The results speak for themselves. Let's compare how different LLMs responded to this task.

Results by Model

Claude 3.5 Sonnet (claude.ai)

const emojiScale = ['🙂', '😊', '😃', '😄', '😁', '😆', '😍'];

Gemma2-9b-it (groq.com)

const emojiScale = [
  "😊",
  "😁",
  "😂",
  "🤣",
  "😃",
  "😄",
  "😆"
];

const emojiScale = [
  ":)",
  ":-)",
  ":-)",
  ":-)",
  ":-)",
  ":-)",
  ":-)"
];

Llama3-70b-8192 (groq.com)

const emojiScale = [
  "😊",
  "😊😊",
  "😊😊😊",
  "😊😊😊😊",
  "😊😊😊😊😊",
  "😊😊😊😊😊😊",
  "😊😊😊😊😊😊😊"
];

const emojiScale = [
  "😊",
  "😊😁",
  "😊😁😂",
  "😊😁😂😃",
  "😊😁😂😃😄",
  "😊😁😂😃😄😆",
  "😊😁😂😃😄😆😅"
];

Mixtral-8x7b-32768 (groq.com)

const emojiScale = [
  "😀",
  "😁",
  "😆",
  "😂",
  "🤣",
  "😃",
  "😄"
];

const emojiScale = [
  "😀",
  "😀😊",
  "😀😁",
  "😀😁😂",
  "😀😁😂😃",
  "😀😁😂😃😄",
  "😀😁😂😃😄😆"
];

Gemini (gemini.google.com)

const emojiScale = [
  "😐", // Neutral face for Day 1 (low rating)
  "🙂", // Slightly smiling face for Day 2
  "😊", // Smiling face for Day 3
  "😃", // Grinning face for Day 4
  "😄", // Grinning face with big eyes for Day 5
  "😁", // Grinning face with smiling eyes for Day 6
  "😆", // Beaming face with open mouth for Day 7 (high rating)
];

const emojiScale = [
  "😒", // Unimpressed face for Day 1 (low rating)
  "😐", // Neutral face for Day 2
  "🙂", // Slightly smiling face for Day 3
  "😊", // Smiling face for Day 4
  "😃", // Grinning face for Day 5
  "😄", // Grinning face with smiling eyes for Day 6
  "🥳", // Partying face for Day 7 (high rating)
];

Grok - Fun Mode (x.com/i/grok)

😊
😄
😁
😂
🤣
😆
😅

Standard Perplexity Free model (perplexity.ai)

const emojiScale = [
  "😐", // Neutral face
  "🙂", // Slightly smiling face
  "😊", // Smiling face with smiling eyes
  "😄", // Grinning face with smiling eyes
  "😁", // Beaming face with smiling eyes
  "😆", // Grinning squinting face
  "🤩"  // Star-struck
];

ChatGPT4 (chatgpt.com)

😊
😊😊
😊😊😊
😊😊😊😊
😊😊😊😊😊
😊😊😊😊😊😊
😊😊😊😊😊😊😊