MYCPE ONE

Your firm ran a full revenue recognition training program in the spring. Every staff member completed it. CPE hours were logged. Quiz scores looked fine. Then fall reviews arrived, and managers wrote the same review notes as last year and fixed the same errors themselves.

The training happened. The capability change did not, or at least nobody can prove it did. Attendance, CPE hours, and quiz completion measure activity. They do not measure whether someone can now do the work better. To measure accounting training impact, you need evidence from before and after the training, compared against the same role expectations.

MYCPE ONE Assessments can help establish that evidence. A role- and topic-level baseline before training shows where the gaps sit. A later reassessment against the same expectations shows whether the skill signal changed. Paired with review notes and manager observations, that before-and-after view gives firms a more complete picture of capability change.

Key Takeaways

  • Completion metrics measure activity, not capability change.
  • Build a baseline before training so you have something to compare against.
  • Target training at specific gaps, not generic topics.
  • Reassess after enough time for practice and application.
  • Compare topic-level results, not just total scores.
  • Pair assessment data with workplace evidence and avoid overclaiming causation.

Why Completion Metrics Are Not Enough

Completion shows that someone attended or finished a course. It does not, by itself, show whether the targeted skill changed or whether that change appears in actual work.

The Kirkpatrick Model separates training evaluation into four levels: reaction, learning, behavior, and results. That distinction matters because completion and reaction data do not tell you whether people apply what they learned or whether targeted outcomes change.

Kirkpatrick Partners' newer framing of the model emphasizes connecting training evaluation to performance rather than stopping at completion. For CPA firms, that means asking a harder question: did the work get better?

The pressure to answer that question is growing. The AICPA 2026 CPA Firm Top Issues Survey found that managing change due to technology and AI ranked as the top issue over the next five years for firms of every size. For firms investing in new skills, that makes credible evidence of capability change more useful.

Step 1: Build the Baseline Before Training

A baseline is a snapshot of current capability before development starts. Without one, later before-and-after comparisons are weaker.

A good baseline includes:

  • A role- and level-appropriate skills assessment
  • Topic-level results, not only a total score
  • A sample of recent review notes for each person
  • Manager observations on independence and quality

Keep the baseline focused on the roles and skills you plan to develop. You do not need to test everything.

Step 2: Target the Actual Gap

Generic training can miss the actual gap. If the baseline shows that tax staff are strong on individual returns but weak on partnership basis calculations, focus development on basis calculations.

Use the baseline to:

  • Group people by shared topic gaps
  • Match each group to specific courses, coaching, or practice work
  • Skip training for people who already show strength in the area

Once the gap is clear, firms can match development to the specific topic through courses, coaching, or practice work. Our guide to learning and development for accounting firms explains how to structure that development.

Step 3: Reassess After Enough Time for Application

Timing matters. Reassess too early and the result may reflect short-term recall rather than application. Wait too long and more outside factors can influence the comparison.

There is no universal reassessment window. Reassess after staff have had a reasonable opportunity to apply the skill in real work. The right timing depends on the skill, workflow, and how often the person encounters it.

Keep the reassessment consistent:

  • Use the same role and level expectations
  • Test the same topics
  • Keep testing conditions equivalent

Step 4: Compare Topic-Level Results, Not Just Totals

Total-score changes can hide what happened in the skill the training targeted. A person may improve sharply in that topic while changing little elsewhere, leaving the overall score nearly flat.

Topic-level comparison shows what changed in the skill area being developed. MYCPE ONE Assessments report topic-wise results along with MCQ and simulation performance, so reviewers can see whether changes appear in knowledge, practical application, or both. Where simulations are included, improvement can add evidence that the person is applying the tested knowledge in a practical task.

Step 5: Add Workplace Evidence

Assessment results provide a skill signal. Workplace evidence helps show whether the improvement also appears in actual work.

Review these alongside reassessment results:

  • Review notes: Are the same errors still appearing?
  • Rework: Are managers still correcting the same work?
  • Independence: Does the person need less help?
  • Quality: Are files cleaner at first submission?
  • Manager observations: What changed in daily work?

CTA

Baseline to Reassessment Scorecard

Use this scorecard to organize evidence for each person or group. The example rows below are illustrative.

Skill AreaBaseline EvidenceDevelopment ActionReassessment EvidenceWork EvidenceDecision
Partnership basis45% topic score; frequent review notesTargeted CPE plus two coached returns78% topic scoreFewer basis review notesGap appears to be closing; continue practice
Bank reconciliationsStrong MCQ, weak simulationPractice reconciliations with feedbackSimulation improvedLess manager reworkImprovement visible; continue monitoring
Lease accounting50% topic scoreSelf-paced course only52% topic scoreNo change in review notesNo change; adjust approach
Audit documentationMixed resultsWorkpaper coaching sessionsMixed resultsSome improvement on one engagementMixed; extend coaching

How to Interpret Improvement, No Change, and Mixed Signals

Improvement on assessment and at work. Consistent improvement across the reassessment and workplace evidence suggests that capability is moving in the intended direction. Keep the approach and continue monitoring.

Improvement on assessment, no change at work. The assessment signal improved, but workplace evidence has not changed. Check whether the person had an opportunity to apply the skill, whether coaching or workflow conditions affected application, and whether the reassessment matched the work.

No change on assessment. The reassessment does not show improvement in the tested area. Review whether the development addressed the right gap, whether enough practice occurred, and whether the reassessment matched the intended skill.

Mixed signals. Look deeper. Check whether the person had a chance to use the skill, whether workload affected practice, and whether the assessment and workplace evidence are measuring comparable capability.

How to Avoid Overclaiming Causation

Reassessment shows whether a skill signal changed. It does not prove that training alone caused every improvement.

Other factors can play a role:

  • Experience gained on engagements during the period
  • A new manager who coaches more closely
  • Changes in software or workflow
  • Natural growth over time

Be precise in how you report results. Say "reassessment results improved after targeted training" rather than "the training caused a 30% improvement." Careful wording makes the evidence easier for partners to evaluate.

When Is Reassessment Worth the Effort?

Reassessment takes time, so use it where the stakes are highest:

  • Large or expensive training programs
  • Skills tied to frequent review notes or client risk
  • New technology or methodology rollouts
  • Development plans connected to promotion decisions

For routine or low-risk learning, lighter checks may be enough. For a regular rhythm of evidence, consider quarterly skill audits.

Worked Example: One Tax Team's Before-and-After Cycle

This illustrative example shows how the full cycle fits together.

Baseline (January): A tax team of eight takes a role- and level-appropriate assessment. Topic results show a shared gap in partnership basis and a smaller gap in state apportionment. Review notes from the prior season point to the same basis issue.

Targeted development (February to April): Five people with the basis gap complete targeted CPE and prepare coached returns with feedback. The other three do not receive that targeted training because the baseline did not show the same gap.

Reassessment (July): The same five retake an assessment against the same role expectations. Topic results in basis improve for four of them.

Work evidence (fall): Managers track basis-related review notes on the next set of returns. Notes decline for the four whose reassessment improved. The fifth still needs support, so the development plan shifts to one-on-one coaching.

The team now has clearer evidence of where progress appeared, who still needs support, and what to adjust next.

How to Report Training Impact to Partners

Partners want clear answers, not dashboards full of numbers. Keep reports short:

  • The gap you targeted and why it mattered
  • Who received development and how
  • What changed in reassessment results
  • What changed in real work
  • What you will do next

This format helps partners evaluate L&D activity and capability evidence without overstating results.

Best Practices

  • When capability change will be evaluated, establish a baseline before training where practical.
  • Train on specific topic gaps, not broad subjects.
  • Reassess against the same role expectations and conditions.
  • Compare topic results and section results, not only totals.
  • Pair every reassessment with workplace evidence.
  • Report results with careful, honest language.

Want training to stick over time? See how the best accounting firms build a structured learning culture. For finding gaps in the first place, read our guide to conducting a skills gap analysis.

Common Mistakes

  • Skipping the baseline. Without one, before-and-after skill change is harder to evaluate.
  • Measuring only completion. Hours logged do not equal skill gained.
  • Reassessing too soon. Short-term recall is not the same as durable application.
  • Comparing totals only. Topic changes get lost in the average.
  • Claiming training caused everything. Other factors often contribute.
  • Ignoring work evidence. Skill that never reaches client work has limited value.

Conclusion

For capability-building programs, completion is only the starting point. The more useful question is whether the targeted skill improves and whether that improvement appears in real work. A disciplined before-and-after process builds a baseline, targets specific gaps, reassesses against the same expectations, and compares the result with workplace evidence.

This creates a clearer evidence trail from the original gap to development, reassessment, and workplace application. Ready to build your baseline? Explore MYCPE ONE Assessments to use role- and topic-level assessment evidence as part of a baseline and reassessment process.

FAQs

Compare a baseline assessment with a reassessment against the same role expectations, then review workplace evidence such as review notes, rework, independence, and quality. Improvement across both sources provides more useful evidence than either source alone, while still not proving that training caused the change.

There is no universal timeline. Reassess after staff have had a reasonable opportunity to apply the skill in real work. The timing should reflect the skill, workflow, and how often the person encounters it.

Review both, but use topic-level results to see whether the skill targeted by the training changed. Total scores still provide useful context.

No. It shows that the skill signal changed. Other factors, such as engagement experience and coaching, may also contribute.

Review notes, rework levels, independence, first submission quality, and manager observations.

Look for causes before drawing conclusions. Check testing conditions, workload during the period, and whether the person had a chance to apply the skill. A drop can signal that the training did not fit the gap or that practice time was missing.

No. Focus reassessment on high-cost programs, high-risk skills, and development tied to promotion or other consequential decisions. For routine learning, lighter checks may be enough.

Amrit Singh

Amrit Singh

Amrit Singh is a business leader with 10+ years of experience in continuing education. Helping accounting, tax, and finance professionals stay compliant with ease, he began his journey as a consultant. Learning across industries before stepping into a leadership role, he is shaped by both successes and failures. Amrit is passionate about problem-solving, building products, exploring technology, and mentoring future leaders. He is dedicated to transform continuing education, making it simpler, smarter, and more meaningful. Through his blogs and talks, he shares insights on accounting careers, CPA compliance, and the future of continuing education.

Must Read Blogs