AI Financial Modeling Test for Finance Pros to Understand the Limitations Using Real Tool Comparison

In this episode of The Mod Squad, Paul Barnhurst, Ian Schnoor, and Giles Male put today's leading AI tools to the test in a live financial modeling "bake-off." Using the same modeling case and prompts, they compare ChatGPT, Claude, and Copilot to see how well each tool builds a financial model. The discussion highlights the progress AI has made, where it still falls short, and why financial modeling expertise remains essential.

Expect to Learn:

• How ChatGPT, Claude, and Copilot perform on the same financial modeling task
• The strengths and weaknesses of AI-generated financial models
• Why AI-generated models still require careful review and testing
• How custom instructions and skills can improve AI outputs
• Why financial modeling knowledge is still critical in an AI-driven world

Here are a few quotes from the episode:

• "People are trying to do their jobs and keep up with AI at the same time. It's exhausting." – Ian Schnoor
• "AI is a magnifier, not a replacement for financial modeling skills." – Paul Barnhurst

AI is powerful, but it is not a shortcut to quality work. It still needs guidance, structure, and strong fundamentals. The people who benefit most are those who understand both the tools and the work behind them. For now, the best approach is simple: test it, guide it, and never trust it blindly.

Follow Ian:

LinkedIn - https://www.linkedin.com/in/ianschnoor/

Follow Giles:

LinkedIn - https://www.linkedin.com/in/giles-male-30643b15/

In today’s episode:

[00:00] – Trailer

[03:30] – AI Fatigue & Keeping Up

[05:48] – The Modeling Challenge

[08:41] – ChatGPT Results

[17:57] – Claude Results

[27:33] – Copilot Results

[30:36] – Human Review Still Matters

[33:18] – How AI Has Improved

[36:10] – Better Results with Custom Skills

[37:08] – Final Verdict & Key Takeaways