# Image Recognition How to get the best results when analyzing images with your Chipp app --- Your Chipp app can analyze images uploaded by users. This guide explains how image recognition works and how to get the best results. ## How It Works When a user uploads an image, Chipp processes it in one of two ways depending on your app's model: ### Vision-Capable Models (Recommended) Models with native vision capabilities see images directly, just like a human would. The image is embedded in the conversation and the model can reference it naturally. **Vision-capable models:** | Provider | Models | |----------|--------| | OpenAI | GPT-5 family (GPT-5.x, GPT-5 Mini, GPT-5 Nano), GPT-4.1, GPT-4.1 Mini, GPT-4.1 Nano, GPT-4o | | Anthropic | All Claude models (Claude Sonnet 5.5, Claude Opus 5.5, Claude Haiku 5.5, Claude Sonnet 4.x, Claude Opus 4.x, Claude Haiku 4.5, Claude 3.x) | | Google | Gemini 3.x (Gemini 3.1 Pro Preview, Gemini 3.5 Flash) | **Models WITHOUT vision:** - OpenAI o-series (o1, o1 Pro, o3, o3 Pro, o3-mini, o4 Mini) ### Non-Vision Models (Fallback) Models without native vision (like the o-series reasoning models) cannot see uploaded images. Chipp does not pass the image to these models, so the model only sees your user's text. Through the API, a request that attaches an image to a non-vision model is rejected with an `IMAGE_INPUT_UNSUPPORTED_BY_MODEL` error. If your app needs to understand images, choose a vision-capable model. ## Getting the Best Results ### 1. Choose the Right Model For apps that heavily rely on image analysis, select a vision-capable model: 1. Go to your app in the Chipp dashboard 2. Go to **Brain** > **Prompt** and find the **Intelligence** card 3. Under **Chat Model**, select a vision-capable model like GPT-5 or Claude Sonnet 5.5 ### 2. Enable Image Upload Make sure users can upload images: 1. Go to **Brain** > **Capabilities** and expand the **Customize** card 2. Find **Image Upload** ("Allow users to upload images for the model to see") 3. Toggle it **ON** ### 3. Image Quality Tips For best recognition accuracy: - **Resolution**: Higher resolution images produce better results - **Lighting**: Well-lit images are easier to analyze - **Focus**: Ensure the subject is in focus and not blurry - **Format**: JPEG, PNG, GIF, and WebP are all supported ### 4. Prompting for Analysis Guide users to be specific about what they want analyzed: **Good prompts:** - "What math equations are shown in this image?" - "Identify all the plants in this photo" - "What text appears on this sign?" **Vague prompts:** - "What is this?" - "Tell me about the image" ## Comparing to ChatGPT If you notice differences between your Chipp app and ChatGPT's native image analysis, consider: 1. **Model selection**: ChatGPT uses GPT-5 by default. Ensure your Chipp app also uses GPT-5 or a comparable vision model like Claude Sonnet 5.5. 2. **System prompt**: Your app's personality and instructions may influence how it interprets images. ChatGPT has different default behaviors. 3. **Context window**: ChatGPT maintains conversation context differently. For complex multi-image analysis, results may vary. ## Troubleshooting ### Images Not Being Analyzed - Verify **Image Upload** is enabled in your app's **Customize** card - Verify your app uses a vision-capable model - Check that the user is uploading supported formats (JPEG, PNG, WebP, GIF) - Ensure images are from supported sources (direct uploads, not all external URLs) ### Poor Accuracy - Switch to a vision-capable model (GPT-5, Claude Sonnet 5.5, etc.) - Ask users to provide clearer, higher-resolution images - Add specific instructions in your system prompt about how to analyze images ### Slow Response Times Image analysis typically takes 5-15 seconds depending on image complexity. For faster responses: - Use smaller image files when possible - Consider GPT-5 Nano or Claude Haiku 4.5 for speed vs. accuracy tradeoff ## Model Comparison for Vision | Model | Vision Quality | Speed | Best For | |-------|---------------|-------|----------| | GPT-5 | Excellent | Medium | Complex reasoning about images | | Claude Sonnet 4.6 | Excellent | Fast | Detailed visual descriptions | | Gemini 3.1 Pro Preview | Excellent | Medium | Multi-image comparisons, long context | | GPT-5 Mini | Very Good | Fast | Balanced performance | | GPT-5 Nano | Good | Very Fast | Quick, simple analysis | | Claude Haiku 4.5 | Good | Very Fast | Fast responses | | Gemini 3.5 Flash | Very Good | Fast | Balanced speed and quality |