Measure & LearN
Our goal is to identify which digital actions and touchpoints work, which ones don’t, and find ways to improve programs as we go
The Challenges with Traditional Measurement
Not based on behavioral data
Most data is attendance data
Usually change is self reported and gathered in long surveys
Long lead time between data gathering and revision and implementation
What Success Looks Like
Teams identify important indicators to capture before, during, and after sessions
You have the right tools to capture and anlyze real-time feedback
Teams make space for participants voices, behaviors and their needs
Teams revise interactions based on feedback and digital behavior
Measurement and learning doesn’t have to be complicated. Here are five different practical and simple approaches to listen, learn, and level up
WAYS TO MEASURE & LEARN
Self Reported Tools: Quick Pulse Checks
To get real-time feedback on how people feel about the programs, design short-targeted surveys or check-ins during or right after a session to measure relevance, usefulness, and satisfaction
Tools
– Online surveys (Google Forms, Typeform) that include Likert scale, multiple-choice questions, or/and open-ended questions for deeper insights.
– Voice note responses via WhatsApp or Telegram
Key Indicators to Keep Track Of
– Net Promoter Score (NPS): "How likely are you to recommend this program to a friend?"
– Relevance: "Was this useful for your situation?"
– Satisfaction: "How would you rate today's session?"
– Confidence shifts: Before/after questions on motivation
Useful Resources
Google’s HEART Framework
–Tool: 20 questions to understand your users
–Identify user preferences, barriers, and more to design successful training sessions.
WAYS TO MEASURE & LEARN
Conversations: Deep Dives
Take the time to go deeper with structured interviews and casual debriefs to better understand the emotional context and barriers. Ask, listen, and explore what’s underneath
Tools
– One-on-one interviews
– Post-session debriefs
– Peer retrospectives
– Focus groups (in person or via Zoom)
Key Indicators to Keep Track Of
– Recurring themes
– Frequency of challenges
– Actionable suggestions for program improvements
Useful Resources
Guide for retrospectives
Learn how to use Agile Retrospective to collect Client Feedback
Audio-to-text tools (Tactiq)
Learn how to use Tacqtic, an automatic speech recognition tech to provide transcription of interviews
WAYS TO MEASURE & LEARN
Community Listening: How They React
Monitor how participants / users are reacting in group chats, forums, and shared spaces. Track reactions, questions, interactions, and suggestions
Tools
– WhatsApp groups (threads, comments)
– Facebook groups (polls and reactions, publications)
– Comment threads on shared resources or communities
Key Indicators to Keep Track Of
– Number of comments or replies
– Type of questions being asked
– Emoji reactions (as a signal of sentiment)
– Emerging topics or concerns
Useful Resources
Lorem Ipsum
Lorem ipsum
Go to resource >
WAYS TO MEASURE & LEARN
Behavioral Analytics: What They Do
Track what participants / users actually do. Do they show up to your sessions? Do they interact and engage with the activities you design? Use this data to lead your design and spot gaps between your objectives and behaviors
Tools
– Zoom or WhatsApp group analytics
– Session attendance patterns
– Chat activity
Key Indicators to Keep Track Of
– Attendance and drop-off rates
– Completion rates for activities
– Number and timing of messages sent
– Engagement peaks during a session or activity
Useful Resources
How to Measure Customer Engagement in Whatsapp
Focus on a set of key metrics that reflect customer engagement with this guide.
How to Track Engagement in Facebook
View insights about a Facebook group that you admin
Zoom Meeting Reports Guide
How to download attendance, polling, and registration reports on Zoom.
WAYS TO MEASURE & LEARN
AI-Powered Analysis
Use chatbots like Equimundo’s Aly to collect, analyze, and respond to user insights. Imagine a chatbot is in charge of collecting, analyzing and synthesizing the data in real time so that you can be in charge of designing your sessions
Tools
– Chatbots with feedback prompts
– AI transcriptions
– Analysis and synthesis
Key Indicators to Keep Track Of
– Question patterns: What participants ask
– Recurring themes
– Frequency of challenges
– Actionable suggestions for program improvements
– Net Promoter Score (NPS), Satisfaction and more
Useful Resources
he Role of AI in Qualitative Data Collection and Analysis
Learn more about the power of AI in qualitative research
Finally, It Is All About Adopting the Right Mindset
To make the most of the methods and tools on the site, we recommend adopting an iterative mindset. This means starting small, learning from what works, and continuously improving your digital approaches rather than attempting perfect solutions immediately. These are the recommended steps for an iterative mindset:
