Senior AI Engineer - Document AI - India

About Lighthouz AI

Lighthouz AI is automating the back office of freight finance with freight-native AI agents. We help freight brokers, 3PLs, and factoring companies process invoices, rate confirmations, and PoDs in seconds—not hours—by replacing manual audits and brittle RPA with intelligent automation.

Our platform handles real-world document chaos—scanned and handwritten paperwork, NOAs, BOLs, emails, and portal logins—executing complex workflows automatically. The result: faster payments, fewer disputes, and 10x operational throughput.

We’re a Y Combinator S24 company founded by a team with deep experience across AI, supply chain, and enterprise systems (Google, Georgia Tech, Progressive, Halliburton). At Lighthouz, we’re not just streamlining freight finance—we’re rebuilding it from the ground up.

---

About the Role

We’re hiring a Senior AI Engineer with expertise in document understanding, Computer Vision, and OCR to help build the brains behind our AI agents. You’ll work on the two core components of our AI agents – first, the core perception systems that extract structured insights from messy, real-world freight documents—handwritten, scanned, distorted, or multi-page – and second, our AI agents for email and voice communications between freight entities. You will do a lot of prompt engineering, fine tuning LLMs, fine-tuning VLMs, combining VLMs with OCR, building large-scale document classification and entity extraction models – your code will be at the heart of automating financial decision-making in freight.

You’ll collaborate closely with the backend and product teams to bring AI models to life in production environments and continuously improve performance in the wild.

---

What You’ll Do

👉🏼 Build and fine-tune AI models for document classification, VLMs, LLMs, OCR, entity recognition, and layout parsing
👉🏼 Develop scalable pipelines for pre-processing, training, inference, and feedback loops
👉🏼 Evaluate and integrate VLMs
👉🏼 Create ensemble VLM and OCR models

👉🏼 Create layout-aware document processing systems

👉🏼 Annotate, clean, and curate diverse freight documents for robust model performance

👉🏼Build training, evaluation, and test datasets 

👉🏼Identify issues identified in production data and fix them asap 

👉🏼Iterate on improving existing and new AI stack
👉🏼 Productionize AI models as part of Lighthouz’s intelligent automation stack
👉🏼 Collaborate with backend engineers to integrate model outputs into document, email, and voice workflows
👉🏼 Continuously monitor and improve model performance in real-world conditions

---

What We’re Looking For

👉🏼 3–6 years experience in ML or AI roles, preferably focused on computer vision or document AI
👉🏼 Strong foundation in deep learning frameworks (e.g., PyTorch, TensorFlow)
👉🏼 Experience in fine-tuning VLMs and LLMs 
👉🏼Experience in voice AI
👉🏼 Experience with document/image OCR, visual transformers, and multimodal models
👉🏼 Proficiency in Python and common ML tooling (e.g., Hugging Face, OpenCV, spaCy)
👉🏼 Hands-on experience training and deploying models in production
👉🏼 Strong problem-solving skills and a builder mindset—you move fast and iterate faster
👉🏼 Comfortable working with ambiguity and evolving datasets
👉🏼 Willingness to work long hours 

---

Nice to Have

👉🏼 Familiarity with freight, logistics, or fintech workflows
👉🏼 Experience with AWS, Azure, or GCP-based ML infrastructure
👉🏼 Exposure to RAG pipelines, foundation models, or vector search systems
👉🏼 Knowledge of document layout understanding (e.g., Donut, LayoutLM, PubLayNet)
👉🏼 Background in building secure, production-grade ML services

---

What We Offer

💰 Competitive salary
🌎 Fully remote
🛠️ High ownership, zero bureaucracy—help shape our AI stack from day one
🚀 Work on impactful real-world problems that blend AI and automation at scale