Your firm ran a full revenue recognition training program in the spring. Every staff member completed it. CPE hours were logged. Quiz scores looked fine. Then fall reviews arrived, and managers wrote the same review notes as last year and fixed the same errors themselves.
The training happened. The capability change did not, or at least nobody can prove it did. Attendance, CPE hours, and quiz completion measure activity. They do not measure whether someone can now do the work better. To measure accounting training impact, you need evidence from before and after the training, compared against the same role expectations.
MYCPE ONE Assessments can help establish that evidence. A role- and topic-level baseline before training shows where the gaps sit. A later reassessment against the same expectations shows whether the skill signal changed. Paired with review notes and manager observations, that before-and-after view gives firms a more complete picture of capability change.
Completion shows that someone attended or finished a course. It does not, by itself, show whether the targeted skill changed or whether that change appears in actual work.
The Kirkpatrick Model separates training evaluation into four levels: reaction, learning, behavior, and results. That distinction matters because completion and reaction data do not tell you whether people apply what they learned or whether targeted outcomes change.
Kirkpatrick Partners' newer framing of the model emphasizes connecting training evaluation to performance rather than stopping at completion. For CPA firms, that means asking a harder question: did the work get better?
The pressure to answer that question is growing. The AICPA 2026 CPA Firm Top Issues Survey found that managing change due to technology and AI ranked as the top issue over the next five years for firms of every size. For firms investing in new skills, that makes credible evidence of capability change more useful.
A baseline is a snapshot of current capability before development starts. Without one, later before-and-after comparisons are weaker.
A good baseline includes:
Keep the baseline focused on the roles and skills you plan to develop. You do not need to test everything.
Generic training can miss the actual gap. If the baseline shows that tax staff are strong on individual returns but weak on partnership basis calculations, focus development on basis calculations.
Use the baseline to:
Once the gap is clear, firms can match development to the specific topic through courses, coaching, or practice work. Our guide to learning and development for accounting firms explains how to structure that development.
Timing matters. Reassess too early and the result may reflect short-term recall rather than application. Wait too long and more outside factors can influence the comparison.
There is no universal reassessment window. Reassess after staff have had a reasonable opportunity to apply the skill in real work. The right timing depends on the skill, workflow, and how often the person encounters it.
Keep the reassessment consistent:
Total-score changes can hide what happened in the skill the training targeted. A person may improve sharply in that topic while changing little elsewhere, leaving the overall score nearly flat.
Topic-level comparison shows what changed in the skill area being developed. MYCPE ONE Assessments report topic-wise results along with MCQ and simulation performance, so reviewers can see whether changes appear in knowledge, practical application, or both. Where simulations are included, improvement can add evidence that the person is applying the tested knowledge in a practical task.
Assessment results provide a skill signal. Workplace evidence helps show whether the improvement also appears in actual work.
Review these alongside reassessment results:
Use this scorecard to organize evidence for each person or group. The example rows below are illustrative.
| Skill Area | Baseline Evidence | Development Action | Reassessment Evidence | Work Evidence | Decision |
|---|---|---|---|---|---|
| Partnership basis | 45% topic score; frequent review notes | Targeted CPE plus two coached returns | 78% topic score | Fewer basis review notes | Gap appears to be closing; continue practice |
| Bank reconciliations | Strong MCQ, weak simulation | Practice reconciliations with feedback | Simulation improved | Less manager rework | Improvement visible; continue monitoring |
| Lease accounting | 50% topic score | Self-paced course only | 52% topic score | No change in review notes | No change; adjust approach |
| Audit documentation | Mixed results | Workpaper coaching sessions | Mixed results | Some improvement on one engagement | Mixed; extend coaching |
Improvement on assessment and at work. Consistent improvement across the reassessment and workplace evidence suggests that capability is moving in the intended direction. Keep the approach and continue monitoring.
Improvement on assessment, no change at work. The assessment signal improved, but workplace evidence has not changed. Check whether the person had an opportunity to apply the skill, whether coaching or workflow conditions affected application, and whether the reassessment matched the work.
No change on assessment. The reassessment does not show improvement in the tested area. Review whether the development addressed the right gap, whether enough practice occurred, and whether the reassessment matched the intended skill.
Mixed signals. Look deeper. Check whether the person had a chance to use the skill, whether workload affected practice, and whether the assessment and workplace evidence are measuring comparable capability.
Reassessment shows whether a skill signal changed. It does not prove that training alone caused every improvement.
Other factors can play a role:
Be precise in how you report results. Say "reassessment results improved after targeted training" rather than "the training caused a 30% improvement." Careful wording makes the evidence easier for partners to evaluate.
Reassessment takes time, so use it where the stakes are highest:
For routine or low-risk learning, lighter checks may be enough. For a regular rhythm of evidence, consider quarterly skill audits.
This illustrative example shows how the full cycle fits together.
Baseline (January): A tax team of eight takes a role- and level-appropriate assessment. Topic results show a shared gap in partnership basis and a smaller gap in state apportionment. Review notes from the prior season point to the same basis issue.
Targeted development (February to April): Five people with the basis gap complete targeted CPE and prepare coached returns with feedback. The other three do not receive that targeted training because the baseline did not show the same gap.
Reassessment (July): The same five retake an assessment against the same role expectations. Topic results in basis improve for four of them.
Work evidence (fall): Managers track basis-related review notes on the next set of returns. Notes decline for the four whose reassessment improved. The fifth still needs support, so the development plan shifts to one-on-one coaching.
The team now has clearer evidence of where progress appeared, who still needs support, and what to adjust next.
Partners want clear answers, not dashboards full of numbers. Keep reports short:
This format helps partners evaluate L&D activity and capability evidence without overstating results.
Want training to stick over time? See how the best accounting firms build a structured learning culture. For finding gaps in the first place, read our guide to conducting a skills gap analysis.
For capability-building programs, completion is only the starting point. The more useful question is whether the targeted skill improves and whether that improvement appears in real work. A disciplined before-and-after process builds a baseline, targets specific gaps, reassesses against the same expectations, and compares the result with workplace evidence.
This creates a clearer evidence trail from the original gap to development, reassessment, and workplace application. Ready to build your baseline? Explore MYCPE ONE Assessments to use role- and topic-level assessment evidence as part of a baseline and reassessment process.
Compare a baseline assessment with a reassessment against the same role expectations, then review workplace evidence such as review notes, rework, independence, and quality. Improvement across both sources provides more useful evidence than either source alone, while still not proving that training caused the change.
There is no universal timeline. Reassess after staff have had a reasonable opportunity to apply the skill in real work. The timing should reflect the skill, workflow, and how often the person encounters it.
Review both, but use topic-level results to see whether the skill targeted by the training changed. Total scores still provide useful context.
No. It shows that the skill signal changed. Other factors, such as engagement experience and coaching, may also contribute.
Review notes, rework levels, independence, first submission quality, and manager observations.
Look for causes before drawing conclusions. Check testing conditions, workload during the period, and whether the person had a chance to apply the skill. A drop can signal that the training did not fit the gap or that practice time was missing.
No. Focus reassessment on high-cost programs, high-risk skills, and development tied to promotion or other consequential decisions. For routine learning, lighter checks may be enough.
Amrit Singh is a business leader with 10+ years of experience in continuing education. Helping accounting, tax, and finance professionals stay compliant with ease, he began his journey as a consultant. Learning across industries before stepping into a leadership role, he is shaped by both successes and failures. Amrit is passionate about problem-solving, building products, exploring technology, and mentoring future leaders. He is dedicated to transform continuing education, making it simpler, smarter, and more meaningful. Through his blogs and talks, he shares insights on accounting careers, CPA compliance, and the future of continuing education.
Crack the Code: Unleashing Hidden Talents for Workplace Magic
Understanding Your Talent Development Function
Fundamentals of Managing and Developing Talent