From Photo to Payout: A Gemini-Native Multi-Agent System for Real-Time Auto Claims
## Project Goal and Business Impact Imagine starting an auto insurance claim simply by photographing the damaged vehicle with your phone. Before the claim is analyzed, an AI agent verifies that the submitted image is clear, properly framed, sufficiently illuminated, and suitable for an accurate assessment. Within minutes, the system can then generate a structured damage evaluation, compare potential repair strategies, and identify relevant repair facilities. The primary objective of this project is to improve the speed, consistency, and transparency of the initial auto insurance claims process. Traditional assessments often depend on manual inspections, fragmented information, and time-consuming repair estimates. These steps can delay claim resolution, increase operational costs, and create inconsistencies between evaluations. This application introduces a Gemini-powered Multi-Agent System that transforms vehicle photographs into a comprehensive preliminary claims assessment. It is designed to support insurers, claims professionals, repair specialists, and customers by providing a rapid, data-driven starting point for claim triage and further investigation. The generated assessment is intended to support the initial evaluation process rather than replace a certified vehicle inspection, professional repair quotation, or final insurance decision. ## The Multi-Agent Architecture At the center of the application is an Orchestrator Agent that manages the complete claims-analysis workflow. It determines the order in which tasks must be performed, sends the appropriate information to each specialist agent, monitors their execution, handles dependencies, and combines their outputs into a coherent final report. The architecture includes several Gemini-powered agents, each responsible for a specific stage of the evaluation. ### Photo Quality Agent The Photo Quality Agent acts as the first validation layer in the workflow. Before any damage assessment begins, it determines whether the uploaded photograph contains enough reliable visual information for further analysis. The agent checks for issues such as excessive blur, poor lighting, reflections, unsuitable camera angles, low resolution, obstructions, excessive distance from the vehicle, and incomplete visibility of the damaged area. When the photograph is unsuitable, the agent explains the problem and provides practical instructions for taking a better image. This prevents low-quality visual evidence from propagating through the remaining agents and producing unreliable estimates. By introducing an explicit quality-control stage, the system improves the reliability of every subsequent decision. ### Vision and Damage Assessment Agent Once the photograph passes the quality check, the Vision Agent uses Gemini’s multimodal capabilities to examine the vehicle and identify visible damage. The agent determines which vehicle components appear to be affected, such as bumpers, body panels, doors, fenders, headlights, mirrors, windows, and wheels. It also classifies the visible damage according to categories such as scratches, dents, cracks, paint damage, deformation, broken components, and collision-related damage. The assessment includes an estimated severity level—minor, moderate, or severe—together with a technical explanation of the visual evidence supporting the classification. Where the available image does not provide enough information to reach a reliable conclusion, the agent records the limitation instead of presenting an unsupported diagnosis. ### OEM Cost Estimation Agent The OEM, or Original Equipment Manufacturer, Cost Estimation Agent evaluates a premium repair scenario. Its analysis prioritizes manufacturer-approved repair procedures, original replacement parts, authorized repair facilities, specialized labor, paint matching, calibration requirements, and other services that may be necessary to restore the vehicle according to manufacturer standards. The agent uses the damage assessment, the affected components, the estimated labor involved, and the available vehicle and market context to generate an indicative cost range. ### Aftermarket Cost Estimation Agent The Aftermarket Cost Estimation Agent evaluates a more cost-conscious repair strategy. It considers certified aftermarket parts, compatible replacement components, independent repair facilities, alternative labor rates, component repair instead of replacement, and other approaches that may reduce the total repair cost while maintaining acceptable quality and safety standards. Running the OEM and Aftermarket agents separately allows the system to present two clearly differentiated repair scenarios rather than producing a single unexplained estimate. ### Shop Finder Agent The Shop Finder Agent identifies repair facilities that may be relevant to the user’s location and the type of damage detected. It can organize available information such as shop names, areas of specialization, contact details, ratings, proximity, and other useful selection criteria. Its search strategy can adapt according to the vehicle components involved and the repair approach being considered. For example, a severe collision assessment may prioritize body shops with structural repair and calibration capabilities, while a minor scratch may require only a paint and cosmetic repair specialist. ## Gemini-Native Technical Architecture The new application is built entirely around Gemini and the Google AI ecosystem. Google AI Studio provides the development environment for designing, testing, and refining the application and its agent workflows. Gemini supplies the multimodal understanding and reasoning capabilities used throughout the system, including image-quality evaluation, vehicle-damage analysis, repair-scenario generation, information synthesis, and final report creation. Rather than relying on different model providers for individual tasks, the application uses a unified Gemini-based architecture. This simplifies communication between agents, reduces integration complexity, and creates a more consistent data flow across the complete pipeline. The application is deployed on Google Cloud Run, providing a managed environment for running the web application and its backend services. This deployment model enables the system to be made available as an online application while supporting scalable, production-oriented execution. ## State Management and Agent Coordination The system maintains a shared claim state containing the information produced during each stage of the workflow. This state may include the uploaded photograph, photo-quality results, detected vehicle components, damage classifications, severity levels, confidence indicators, repair assumptions, cost scenarios, location information, shop results, warnings, and unresolved questions. Each agent receives only the context required for its task and returns a structured result to the Orchestrator Agent. The orchestrator then verifies that the required stages have been completed and combines the individual outputs into a unified claims-assessment report. Confidence indicators help distinguish between strong visual evidence and uncertain conclusions. When an agent has insufficient information, the system can communicate that uncertainty, request another photograph, or recommend professional inspection. ## Agent Execution and Transparency Each agent follows a ReAct-inspired execution pattern based on planning, action, observation, and refinement. The agent first evaluates its assigned objective and the available claim context. It then selects an appropriate action, processes the relevant information, observes the result, and determines whether further analysis is necessary. Instead of exposing private model reasoning, the application can provide a structured activity log containing the task assigned to each agent, the action performed, the evidence considered, the resulting observation, the confidence level, and the final output. This creates an auditable execution trace that allows users to understand how the assessment progressed from image validation to damage analysis, cost estimation, repair-shop identification, and final report generation. ## Generative AI Compared with Traditional Tools Traditional automated vehicle-inspection systems often depend on fixed computer-vision models, predefined rules, static repair databases, or monolithic processing pipelines. These solutions can be effective for narrowly defined tasks, but they may struggle to interpret incomplete evidence, adapt their workflow, explain uncertainty, or combine multiple types of information. The Gemini-powered Multi-Agent System introduces a modular reasoning and coordination layer between the original photograph and the final assessment. Each specialist agent has a clearly defined responsibility, input, output, and confidence level. This makes the workflow easier to inspect, test, extend, and improve than a single large prompt or an opaque end-to-end script. The modular structure also supports the future development of a hybrid architecture. Individual agents could be replaced or supplemented by deterministic computer-vision models, manufacturer repair databases, parts catalogues, pricing APIs, mapping services, fraud-detection systems, or human-review checkpoints without redesigning the entire application. Generative AI therefore operates as the coordination and interpretation layer, while specialized conventional systems can provide additional precision for individual tasks. ## The Future of Insurance Claims This application demonstrates how Gemini-powered agents can collaborate to automate complex, multimodal business workflows. The architecture goes beyond basic vehicle-damage recognition. It validates the quality of the submitted evidence, analyzes visible damage, compares different repair approaches, identifies potentially relevant repair providers, manages uncertainty, and combines the results into a transparent preliminary assessment. The same architecture could eventually support additional agents for vehicle identification, document analysis, policy verification, fraud indicators, repair authorization, parts availability, claims-history analysis, payment recommendations, and mandatory human approval. Built with Gemini in Google AI Studio and deployed on Google Cloud Run, the project provides a scalable blueprint for developing intelligent, modular, and explainable insurance applications. It shows how a coordinated team of specialized AI agents can transform a single vehicle photograph into actionable claims information, reducing initial processing time while keeping uncertainty, traceability, and professional oversight at the center of the workflow. link to the web app: https://multi-agent-car-damage-evaluation.ai.studio