Andromeda Computer Benchmarks

Language

generate tps

prompt tps

prompt tps/watt

generate tps/watt

avg watts

avg ttft

tinyllama-chat

generate tps

phi-3-mini-4k-instruct

generate tps

llama3-8B-instruct

generate tps

phi3-medium

generate tps

tinyllama-chat

prompt tps

phi-3-mini-4k-instruct

prompt tps

llama3-8B-instruct

prompt tps

phi3-medium

prompt tps

tinyllama-chat

prompt tps/watt

phi-3-mini-4k-instruct

prompt tps/watt

llama3-8B-instruct

prompt tps/watt

phi3-medium

prompt tps/watt

tinyllama-chat

generate tps/watt

phi-3-mini-4k-instruct

generate tps/watt

llama3-8B-instruct

generate tps/watt

phi3-medium

generate tps/watt

tinyllama-chat

avg watts

phi-3-mini-4k-instruct

avg watts

llama3-8B-instruct

avg watts

phi3-medium

avg watts

tinyllama-chat

avg ttft

phi-3-mini-4k-instruct

avg ttft

llama3-8B-instruct

avg ttft

phi3-medium

avg ttft

Vision

generate tps

prompt tps

prompt tps/watt

generate tps/watt

avg watts

avg ttft

moondream2

generate tps

moondream2

prompt tps

moondream2

prompt tps/watt

moondream2

generate tps/watt

moondream2

avg watts

moondream2

avg ttft

Hearing

total transcribe time

avg speedup

avg speedup/watt

whisper-tiny

total transcribe time

whisper-large-v3

total transcribe time

whisper-tiny

avg speedup

whisper-large-v3

avg speedup

whisper-tiny

avg speedup/watt

whisper-large-v3

avg speedup/watt

Creation

avg iter/sec

avg sec/iter

avg time to image

avg iter/sec/watt

sdxl-base-1.0-512

avg iter/sec

sdxl-lightning-4step-512

avg iter/sec

sdxl-base-1.0-1024

avg iter/sec

sdxl-lightning-4step-1024

avg iter/sec

sdxl-base-1.0-512

avg sec/iter

sdxl-lightning-4step-512

avg sec/iter

sdxl-base-1.0-1024

avg sec/iter

sdxl-lightning-4step-1024

avg sec/iter

sdxl-base-1.0-512

avg time to image

sdxl-lightning-4step-512

avg time to image

sdxl-base-1.0-1024

avg time to image

sdxl-lightning-4step-1024

avg time to image

sdxl-base-1.0-512

avg iter/sec/watt

sdxl-lightning-4step-512

avg iter/sec/watt

sdxl-base-1.0-1024

avg iter/sec/watt

sdxl-lightning-4step-1024

avg iter/sec/watt