AI Engineer - Document AI - India

About Lighthouz AI

Lighthouz AI is automating the back office of freight finance with freight-native AI agents. We help freight brokers, 3PLs, and factoring companies process invoices, rate confirmations, and PoDs in seconds—not hours—by replacing manual audits and brittle RPA with intelligent automation.

Our platform handles real-world document chaos—scanned and handwritten paperwork, NOAs, BOLs, emails, and portal logins—executing complex workflows automatically. The result: faster payments, fewer disputes, and 10x operational throughput.

We’re a Y Combinator S24 company founded by a team with deep experience across AI, supply chain, and enterprise systems (Google, Georgia Tech, Progressive, Halliburton). At Lighthouz, we’re not just streamlining freight finance—we’re rebuilding it from the ground up.

---

About the Role

We’re hiring a Senior AI Engineer with expertise in document understanding, Computer Vision, and OCR to help build the brains behind our AI agents. You’ll work on the two core components of our AI agents – first, the core perception systems that extract structured insights from messy, real-world freight documents—handwritten, scanned, distorted, or multi-page – and second, our AI agents for email and voice communications between freight entities. You will do a lot of prompt engineering, fine-tuning LLMs and VLMs, combining VLMs with OCR, building large-scale document classification and entity extraction models, communication understanding, intent classification, and voice AI – your code will be at the heart of automating financial decision-making in freight.

You’ll collaborate closely with the backend and product teams to bring AI models to life in production environments and continuously improve performance in the wild.

---

What You’ll Do

👉🏼 Prompt engineering on LLMs and VLMs for document understanding and data extraction
👉🏼 Build and fine-tune VLMs and LLMs for document classification, OCR, entity recognition, and layout parsing
👉🏼 Develop scalable pipelines for pre-processing, training, inference, and feedback loops
👉🏼 Evaluate and integrate VLMs
👉🏼 Integrate LLMs and VLMs with OCR
👉🏼 Annotate, clean, and curate diverse freight documents for robust model performance
👉🏼Build training, evaluation, and test datasets 
👉🏼Identify issues identified in production data and fix them asap 
👉🏼Iterate on improving existing and new AI stack
👉🏼 Productionize AI models as part of Lighthouz’s intelligent automation stack
👉🏼 Collaborate with backend engineers to integrate model outputs into document, email, and voice workflows
👉🏼 Continuously monitor and improve model performance in real-world conditions

---

What We’re Looking For

👉🏼 2+ years experience in ML or AI roles, preferably focused on document AI
👉🏼 Strong foundation in deep learning frameworks (e.g., PyTorch, TensorFlow)
👉🏼 Experience in fine-tuning VLMs and LLMs 
👉🏼 Experience with document/image OCR, visual transformers, and multimodal models
👉🏼 Proficiency in Python and common ML tooling (e.g., Hugging Face, OpenCV, spaCy)
👉🏼 Hands-on experience training and deploying models in production
👉🏼 Strong problem-solving skills and a builder mindset—you move fast and iterate faster
👉🏼 Comfortable working with ambiguity and evolving datasets
👉🏼 Willingness to work long hours 

---

Nice to Have

👉🏼 Familiarity with freight, logistics, or fintech workflows
👉🏼 Experience with AWS, Azure, or GCP-based ML infrastructure
👉🏼 Exposure to RAG pipelines, foundation models, or vector search systems
👉🏼 Knowledge of document layout understanding (e.g., Donut, LayoutLM, PubLayNet)
👉🏼 Background in building secure, production-grade ML services

---

What We Offer

💰 Competitive salary
🌎 Fully remote
🛠️ High ownership, zero bureaucracy—help shape our AI stack from day one
🚀 Work on impactful real-world problems that blend AI and automation at scale