Example of a wrong answer from an Image analysis
#61
by
vince62s
- opened
Use this prompt: List the top 5 countries in Europe with the highest GDP
for the attached image.
Answer is wrong. FYI pixtral12b gives a wrong answer too but mistral-24b-instruct is OK
Based on the provided image, here are the top 5 countries in Europe with the highest GDP:
Germany: $4.65T
United Kingdom: $3.99T
France: $2.78T
Italy: $2.07T
Spain: $1.43T
Hi
@vince62s
, I managed to reproduce the correct output using the Gemma3-4b-it model, as shown below.
Could you please verify this on your end and perhaps you can retry specifically with Gemma3-4b-it?
It's possible the larger models are overfitting or are optimized for more complex tasks, leading to the incorrect results you observed.
Output -
Based on the chart, here's the list:
1. **Germany:** $3.99T (4.65%)
2. **United Kingdom:** $2.82T (3.29%)
3. **France:** $2.78T (3.24%)
4. **Italy:** $2.07T (2.42%)
5. **Spain:** $1.43T (1.66%)
Would you like me to extract any other information from the image, such as the total global GDP or the percentage breakdown of GDP by region?```