The challenge

During the development of Pinterest Academy certification exams, securing consistent SME participation for question creation and review was difficult. This process is time-intensive and typically requires multiple contributors to build an initial question bank of around 200 items. Due to limited SME availability, instructional designers were responsible for creating the majority of the content.

My role

To accelerate question development, I leveraged the company’s internal AI tool, Glean, to build a certification agent. I trained the agent on proper question development protocols, product documentation, sales decks, and other relevant materials, enabling it to generate draft questions aligned to specific exam objectives at scale.

The results

The certification agent reduced time spent searching for documentation and surfaced additional relevant resources. It also generated draft questions that instructional designers could quickly refine, improving alignment with product and sales content. This streamlined the review process and increased efficiency. I also developed and presented a walkthrough of the agent creation process for broader team adoption.