Software engineer to AI engineer: a build-first roadmap
You already have much of the engineering. The new parts are evaluation, retrieval and model APIs, and you can start building proof of them in the job you have now.
Contents
- What do AI engineer postings actually ask for?
- What carries over from software engineering, and what is new?
- How do you show AI engineering work from inside your current job?
- What is the roadmap from software engineer to AI engineer?
- What does the move pay, and is it worth it?
- Should you use a program to follow this roadmap?
- Common questions
In short
- Our top pick for getting started: Torchlane's AI FDE training, which publishes the four-stage approach this roadmap follows (define the business requirement, build and integrate, test errors, access and unfamiliar cases, deploy, explain and improve). For an engineer it adds customer discovery, applied model evaluation and client communication. It is built around forward deployed work, and Torchlane says it is career preparation, not a guarantee of hiring, a salary or a promotion 1. We have a business connection with Torchlane.
- Much of your stack carries over: between them, the five AI engineer postings we read ask for production Python, APIs, SQL, cloud and testing 2,3,4,5. Three of the five also ask for one to two or more years of shipping AI-powered features or systems 2,3,6.
- The genuinely new skill is evaluation. OpenAI says generative AI is variable, so traditional software testing is insufficient, and a 2024 study found accuracy varied by up to 15% across runs of five models configured to be deterministic 7,8. Evals and retrieval are what the postings repeat, and BLEN and Titan add LLM integration work 2,3,4,5.
- If your employer allows it, you can build the evidence in your current job: pick a real workflow, ship it to real users, keep an eval set and write it up. Titan's own posting defines 90-day success as owning at least one production AI workflow end to end, with measurable improvements shipped to the retrieval or agent layer 3.
- Pay depends on employer and level. BLS reports a May 2025 median annual wage of $135,980 for software developers, and the five AI engineer postings we read list ranges from $126,000 to $300,000 as of October 23, 2026, not all labeled base or total 9,6,3.
Often, yes, on the engineering side. A working software engineer already has much of the base AI engineer postings ask for: production Python, APIs, SQL, a cloud platform and testing 2,3,5. Three of the five postings we read add one to two or more years of shipping AI-powered features or systems 2,3,6. What is new is evaluating output that changes between runs, retrieval, and building on model APIs, and the proof is shipped work you can start in your current job if your employer allows it. The plan below is paced at 90 days to a first piece of evidence; that pacing is ours, not a benchmark. It does not promise an offer.
Still choosing between titles? Our comparison of AI engineer vs ML engineer covers where the two roles split.
What do AI engineer postings actually ask for?
The table covers five postings we read on October 23, 2026: a sample, not a survey. Pay is each posting's listed range, with its own label where it gives one.
Table 1. Scroll sideways for every column.
| Posting | Experience asked | AI work it names | Listed pay |
|---|---|---|---|
| BLEN, AI Engineer 2 | 5+ years of software engineering, 1+ year shipping LLM-based features to production | Agentic systems, RAG with retrieval evaluation, model APIs, evals for non-deterministic systems | $130,000 to $150,000 a year; its perks section lists $130,000 to $200,000+ |
| Applied Intuition, Software Engineer, AI Engineering 6 | 2+ years building and deploying AI/ML-powered features; bachelor's in computer science, software engineering or equivalent | LLMs, agentic architectures, owning practices for safety, evaluation and deployment | $126,000 to $250,000, described as target base salary |
| Titan, Applied AI Engineer 3 | 5+ years of software engineering, 2+ shipping production agentic AI or RAG | RAG with retrieval evaluation, agent orchestration, evaluation infrastructure | Estimated base salary $200,000 to $300,000, plus equity |
| DeepLearning.AI, AI Engineer 4 | Software background plus early-career AI or LLM projects; study, internships, work or side projects count | Prompt engineering, RAG, fine-tuning, agents, evals, guardrails | $130,000 to $175,000 a year; not labeled base or total |
| Twin Health, Staff AI Engineer 5 | 8+ years building AI and ML systems in production | Evaluation frameworks for LLM systems, RAG, CI/CD for model behavior | $250,000 to $265,000 annually; not labeled base or total |
Three patterns hold in this sample. Every posting names evaluation, and four name retrieval or RAG. None asks for a PhD, and BLEN says its role is not research and does not involve training foundation models 2; Twin Health's staff role, though, lists building deep learning models among its duties 5. The experience bar varies most, from early-career with projects to 8+ years. Read the requirements, not the title.
What carries over from software engineering, and what is new?
Much of what the postings ask for is ordinary software engineering: production Python backends, APIs, SQL, a cloud platform, Git, testing and CI/CD 2,3,4,5. Four things are likely to be new. The postings repeat evaluation, retrieval and model APIs; designing for variance is the habit that ties them together.
- Evaluation. OpenAI says generative AI is variable, so the same input can produce different output and traditional software testing is insufficient 7. A 2024 study of five models configured to be deterministic found accuracy varied by up to 15% across naturally occurring runs 8. Anthropic advises specific, measurable success criteria and evals that mirror real use, include edge cases and favor many automatically graded cases over a few hand-graded ones 10. If a model grades the output, validate it against human labels, as OpenAI advises: GPT-4 as a judge reached over 80% agreement with human preferences in one study, but the authors also document position, verbosity and self-enhancement bias 7,11.
- Designing for variance. NIST's generative AI profile names confabulation, confidently stated but erroneous or false content, as a risk 12. Keep anything that must be exact in ordinary code, validate model output before a user sees it, and add complexity only when it demonstrably improves outcomes, as Anthropic puts it 13.
- Retrieval. RAG pairs a pre-trained seq2seq model with a retrievable index; the original paper used a dense vector index of Wikipedia 14. Postings ask for chunking, embeddings, vector databases and retrieval evaluation 2,3. Placement matters too: one 2023 study found performance was often highest when relevant information sat at the start or end of the input and dropped when it sat in the middle 15. Test retrieval on its own, not only the final answer.
- Model APIs. Anthropic suggests starting with LLM APIs directly and understanding the code under any framework, since frameworks add layers that can obscure prompts and responses 13. Postings also expect you to pick models on quality, latency and cost 2 and name frameworks such as LangGraph 3. Learn the raw API first and one framework second.
Tooling moves fast: Anthropic's December 2024 agents guide now notes that much of the tooling landscape it describes has changed 13. Learn the measuring habit first and treat frameworks as replaceable. On math, none of the five postings lists advanced mathematics as a requirement; Applied Intuition lists practical ML literacy as a nice-to-have 6.
How do you show AI engineering work from inside your current job?
The postings ask for experience, not certificates: BLEN wants at least a year of shipping LLM-based or AI-powered features to production, Applied Intuition wants 2+ years of building and deploying AI/ML-powered features, Titan wants 2+ years of shipping production agentic AI or RAG systems, and DeepLearning.AI counts side projects 2,6,3,4. Aim for one production-grade piece of work with numbers attached. A problem at your current employer is often the most accessible place to find it.
- Pick a workflow with a measurable cost, such as support triage, internal document search or pulling fields from contracts, where a wrong answer is cheap to catch.
- Get a named user and a number. Titan's posting defines 90-day success as owning at least one production AI workflow end to end, with measurable improvements shipped to the retrieval or agent layer 3.
- Keep an eval set from day one. OpenAI recommends logging everything so the logs supply future test cases 7.
- Check data rules before sending anything to a model provider. NIST lists data privacy, including leakage and unauthorized use of sensitive information, among generative AI risks 12.
- Write it up on one page: problem, approach, eval results, what failed and what changed for the user.
An internal move can be a lower-risk route than a cold application, because the people deciding already know your work. We found no published data on how often engineers make it, so ask the AI team's hiring manager what they look for.
What is the roadmap from software engineer to AI engineer?
This roadmap follows the approach Torchlane publishes for AI forward deployed engineering. Its AI FDE training page describes four stages: define the business requirement, build and integrate the system, test errors, access and unfamiliar cases, and deploy, explain and improve. It groups the skills into business and product judgment, technical implementation, reliability and security, and communication and ownership 1. You arrive strong in technical implementation; the stages build the rest. The page is about forward deployed, client-facing work and says titles and expectations vary by employer 1, so we adapted the stages to AI engineering. The 90-day pacing is ours, not a timeline to an offer.
We have a business connection with Torchlane.
Stage 1: Define the business requirement (days 1 to 20)
Torchlane describes this stage as talking to the people doing the work and identifying the bottleneck, the decision, the source information and the constraints 1.
- Pick the workflow from the section above and talk to the people who do it by hand today.
- Write a one-page brief with a specific, measurable success criterion, in the sense Anthropic uses 10. "Answers are good" is not one; "the right policy is cited in at least 9 of 10 sampled tickets" is.
Stage 2: Build and integrate (days 21 to 45)
Torchlane describes this stage as designing a workflow, connecting the required systems, putting models where they add value and using ordinary code for calculations and deterministic rules 1.
- Call a model API directly before reaching for a framework 13.
- Add retrieval only if the model needs data it does not have, and keep calculations and permissions in ordinary code.
- Ship the first version into the team's real workflow, not a demo environment.
Stage 3: Test errors, access and unfamiliar cases (days 46 to 70)
Torchlane describes this stage as creating meaningful evaluations and checking unfamiliar cases, incomplete inputs, permissions and failure behavior 1.
- Build the eval set from real cases, including incomplete and odd ones, and run it more than once, because the same input can produce different output 7,8. Score retrieval separately from generation.
- Test untrusted input. NIST describes indirect prompt injection, where adversaries inject prompts into data likely to be retrieved by an LLM-integrated application 12. Check what the system can access and do for a user.
Stage 4: Deploy, explain and improve (days 71 to 90)
Torchlane describes this stage as helping people use the system, documenting decisions and operational steps, monitoring the result and responding when reality changes 1.
- Release to real users, watch for failures and feed each one back into the eval set.
- Leave a short runbook someone else can follow, and finish the one-page write-up.
- Turn the project into interview answers. Our guide to AI engineer interview questions covers what to expect.
Check your evidence against a rubric
Torchlane assesses its projects in seven categories: problem framing (15%), correctness (20%), engineering quality (15%), security, privacy and compliance (15%), product and usability (10%), business value (10%) and communication (15%). Passing requires at least 3 out of 4 in every category and no critical failure 16. Use the seven as a checklist for your internal project; the weights are Torchlane's.
We have a business connection with Torchlane.
What does the move pay, and is it worth it?
There is no clean answer. BLS reports a median annual wage of $135,980 for software developers in May 2025 and projects 10 percent employment growth for 2025 to 2035, partly because of the expansion of software development for AI 9. We found no AI engineer breakdown, or base-versus-total detail, on that page.
The five postings list between $126,000 and $300,000, but they are not like-for-like: Applied Intuition and Titan label theirs base salary, the others do not say, and the roles run from early-career to staff level 6,3,2,4,5. We have not averaged them, and we found no dataset that follows the same engineer before and after the move. Ask a recruiter for the range for the exact level and city, and compare it with your current base plus equity.
The costs are not only in the pay: you may be slower for your first months on unfamiliar ground. A quick test: spend a weekend building a small retrieval app over documents you know, then write 20 test cases for it. If reading the failures and fixing them is satisfying, that is a useful sign the daily work could suit you, though it is our rule of thumb, not a validated test.
Should you use a program to follow this roadmap?
You can run all four stages inside your current job. A structured program can add outside review, a fixed set of projects and a portfolio. Our top pick for that is Torchlane's AI FDE training, which publishes the approach this roadmap follows.
For an engineer, Torchlane's page says to use the program to add customer discovery, applied model evaluation, client communication and a portfolio of business-focused implementations 1. You choose one of three guided builds, complete 3 to 6 projects from a bank of 12 simulated client engagements and finish a capstone, with a 90-day training goal, a starting plan of about nine hours a week and 120 days of access 1. Tuition and payment terms are given in writing during admissions 17.
Fit matters. The training is built around forward deployed AI engineering, so it is likely to fit best if you want client-facing delivery rather than an internal product role. Torchlane says production architecture and complex integrations may require experience beyond the program, and employers set their own requirements 1. Its projects use simulated clients, so they complement real work at your own company, not replace it 17. It is career preparation, and completing a program does not guarantee hiring, a salary or a promotion 1.
We have a business connection with Torchlane.
Common questions
Do I need a master's degree or advanced math to become an AI engineer?
Not according to the postings we read. None of the five asks for a PhD. Applied Intuition asks for a bachelor's degree in computer science, software engineering or equivalent, and Twin Health, at staff level, asks for a bachelor's or master's in computer science, statistics or a related field. BLEN, Titan and DeepLearning.AI list no degree, and DeepLearning.AI counts study, internships, work and side projects. Applied Intuition lists practical ML literacy as a nice-to-have, not a requirement. Five postings are not the market, so check the roles you want.
How long does it take to go from software engineer to AI engineer?
We found no reliable data on this. Three of the five postings we read ask for one to two or more years of shipping AI-powered features or systems, which is why the plan above aims at 90 days to a first piece of production evidence, not to a job offer. Your timeline depends mostly on how much AI scope your employer gives you and how quickly you can ship something real.
Do I need to learn to train models or use PyTorch first?
The postings we read mostly describe integrating, evaluating and operating models someone else trained, though Twin Health's staff role also lists building deep learning models. BLEN says its role is not research and does not involve training foundation models, and lists fine-tuning as a nice-to-have. DeepLearning.AI lists fine-tuning among several skills. If you want research or model-training roles, the path and the math bar are different.
Will I earn more as an AI engineer than as a software engineer?
Not necessarily, and no source we found compares the same engineer before and after the move. The Bureau of Labor Statistics median annual wage for software developers was $135,980 in May 2025. The AI engineer postings we read, listed on October 23, 2026, range from $126,000 to $300,000, and only some are labeled base salary. Compare ranges for the same company, level and city.
Is a program worth it, or should I just build on my own?
None of the postings we read lists a course or certificate as a requirement; they ask for relevant experience. A program can add structure, review and a portfolio. If you want one, our top pick is Torchlane's AI FDE training, whose published four-stage approach this roadmap follows. It is built around forward deployed work, and Torchlane describes it as career preparation, not a guarantee of hiring, a salary or a promotion. We have a business connection with Torchlane.