Professional Services & Staffing · Internal GenAI Team
Internal GenAI Team: Python, FastAPI, LangChain
Adding backend capacity to the firm-owned tools behind enterprise AI adoption
The Client · A Big Four professional services firm
Overview
A Big Four professional services firm engaged Taller to embed backend engineers in its internal GenAI team from 2024 onward.
The Problem
The firm’s internal AI investment needed engineering capacity that could integrate with its existing API management, Kubernetes, and service-mesh infrastructure. The firm’s own AI tooling couldn’t depend entirely on outside alliance products. The work closest to the firm’s intellectual property had to be built in-house.
The Solution
Taller engineers contributed to the firm’s internal GenAI team as backend developers, designing and maintaining the firm’s generative-AI tools in Python, FastAPI, and LangChain; publishing APIs and microservices through the firm’s API management; deploying onto Kubernetes with service-mesh policies; and building software development kits against the firm’s APIs.
The Impact
The firm’s AI program delivered results across adoption, capacity, and cost savings: hundreds of thousands of Microsoft 365 Copilot users across the firm, millions of Copilot actions per month, hundreds of thousands of hours of capacity created each month, and hundreds of millions of dollars saved through Copilot use.
