Modernized the gradebook into an actionable dashboard

 

Product Design // User Research @ Pearson

Zach-Kulpa-IE-Dashboard-Screen_iMac_x2
OVERVIEW

We designed a performance dashboard for professors to evaluate student preparation and the need for remediation. 

Snapshot

Role
  • Product Designer
Tools & Tech
  • Sketch
  • InVision
  • Zeplin
Project Duration
  • 1 Year

Methods

Strategy
  • Lean UX Approach
  • Product Ideation 
  • User Flows
Research
  • Task Analysis
  • Journey Mapping
  • Usability Testing
Design
  • Sketches
  • Wireframes
  • Rapid Prototyping

Brief

The aim was to improve Revel, the 'read a little and do a little' Pearson learning tool, by providing an enhanced instructor experience with flexible assignment management. We also created performance analytics to help instructors make data-informed decisions, such as how to prepare for the next class and which students need extra instruction assistance.

Challenge

The discovery phase of this project taught us that instructors are overwhelmed by rapidly evolving technology and systems in the modern classroom. It quickly became clear that the solution was to distill information into smaller pieces that will help instructors monitor grades while understanding how to interact with students in a clear and effective way.

Focus

Revel now offers an updated instructor experience, based on research in the classroom and feedback directly from instructors throughout the design process. The platform currently provides advanced personalization, adaptive learning systems that improve outcomes of education in real-time and allows instructors to identify early interventions.

OUTCOME HIGHLIGHTS

Teammates

  • Albert Christy
  • Devin Knight
  • Jackie Jakob
  • Phil Pochrazt

Educators interviewed

262

User research studies

30

Patents pending

2

THE AIM

Part 1: Purpose

What was the problem we were trying to solve?
STARTING POINT

Simple & Actionable

Instructors immediately see how well their students are preparing for class, the average grade distribution, who needs assistance, and where to focus.

Zach-Kulpa-IE-Multi-Details_x2
EXPLORING INSIGHTS

Our team delivered an enhanced Revel experience that is revived & instinctive to promote better learning outcomes. We built around a framework of welcoming visual design elements, along with simple IA, to provide structure.

Personalized teaching management experience for instructors:

  • Get assignments up and running instantly
  • Make it easy to recognize and reach struggling students
  • Present pleasant content to keep students attentive
Zach-Kulpa-IE-Action5
ADVANCING THE WORK

Attempting to streamline our process and meet the instructors' necessities directly, we used the Lean UX framework. For the first time, we executed Lean methods and ceremonies where possible in the Pearson org & team dynamics.

Collaboratively, we were able to iterative conversations and forward progress a priority over documentation and deliverables. We concentrated on the needs of our customers, finding ways to meet them; all while defining and deliver upon the product and engineering roadmap to realistically build the solution. 

Before & After

Finding the root of their issues

Fully grasping the in-classroom problems by spending time with instructors

Zach-Kulpa-IE-Action2
LEADING WITH A HYPOTHESIS
Zach-Kulpa-IE-Design-Assets20

At the beginning of each sprint, our team would converge on a distinct hypothesis to test and validate. Then we would prototype at varying levels and fidelity of design with instructors in the second week of sprint work.

The hypothesis afforded a precise focus for the particular sprint. For example: "We believe that instructors will discern actionable insights into student performance with progressive views focused on timeliness and relevance."

Zach-Kulpa-IE-DB-Multi-WFs_S
COLLABORATIVE AT EVERY STEP
Zach-Kulpa-IE-Whiteboard8

We relied heavily on a collaborative approach to design decisions made throughout every phase of development. Each sprint, we worked hard to guarantee remote teammates felt welcomed in our collaboration gatherings.

Once we fine-tuned these design studio sessions, it became clear that converging ideas checked a lot of boxes right out of the gate and made it easy to get feedback from instructors instantly with user inquiry every sprint.

Every two weeks, we accomplished the following:

  • SPRINT PLANNING: What questions do we need answered?
  • IDEATION: How might we solve this specific problem?
  • TESTING: What do instructors think?
  • DISCUSSION: What did we learn from instructors?
  • REVIEW: Collaborate w/ stakeholders on next step discussions
THE WORK

Part 2: Process

 

How did we arrive at the solution to the original problem?
PUTTING IN THE WORK

Testing & Iterating

Research is a valuable component of our methods, and the entire team values ongoing user interviews leaning on simple prototypes, guiding the design direction.

Zach-Kulpa-IE-Multi-Screen-WFs_LIGHT-BLUE
ROUGH EDGES
Zach-Kulpa-IE-Action6

When prototyping, we employ the lowest fidelity first to test our ideas and learn fast. Paper keeps the initial solutions adaptable and promotes a more comprehensive spectrum of responses to help us thoroughly understand the mindset and mental models of our customers walking into the classroom.

I enjoy starting with sketches on paper to clarify solutions and get the essential context for discussions with users. This also provides the opportunity to iterate on many divergent ideas before converging with teammates.

We allocate the majority of the first week considering numerous diverse paths and lend little time making sketches perfect. "Each design is a proposed business solution. Your goal is to validate the proposed solution as efficiently as possible by using customer feedback," wrote Jeff Gothelf in Lean UX.

FINDING THE STARTING POINT

Discovery

The remainder of the first week is committed to outlining ideal test flows and building a basic shared understanding of the prototype we're aiming to produce.

Our team as a whole provides many ideas in timed design studio activities using low-fidelity sketches.

Zach Kulpa18
Zach-Kulpa-IE-Whiteboard3
SHAPING THE FRAMEWORK

Definition


I'd evaluate the possibilities and then repeat with more in-depth details on the whiteboard before blocking out paper prototypes with markers and coffee.

Giving the navigation direction

This is where we find the flow that works best for instructors

Zach Kulpa IE Design Assets11
EARLY OUTLINES
Zach-Kulpa-Feedback-Breakfast

Monday and Tuesday of the second week are devoted to polishing the test prototypes and capturing all of our assumptions in a script that our researcher will use to guide the conversations in user interviews with instructors.

The entire team listens in on the remotely moderated tests held on Wednesday and Thursday. By the end of the second day, we all have a shared understanding of validated assumptions along with modifications or needed.

 Sample review of significant insights uncovered with paper prototypes:
- Tell a clear story w/ "Temperature Check" as fundamental element of the flow
- Clarify and simplify data displayed, progressively reveal details as needed
- Highlight data most suitable to where instructors are in the course lifecycle
- View results and completion data by student and assignment organized lists

Streamlining ways of working

Approaching design decisions as a team to keep moving toward solutions to real user issues

Zach-Kulpa-IE-Design-Assets16
CONNECTING VITAL DOTS
Zach-Kulpa-IE-Design-Assets21

On the last Friday of a sprint, we're invigorated to discuss outcomes and lessons learned with a broad group of stakeholders and partners. We review the designs tested and outcomes before agreeing upon the next steps.

The feedback from our broader team on demo day, taken in connection with what we learned from instructors, guides the focus of the next sprint. This simple dialogue helps our team iterate on the top priority work and develop greater confidence and shared understanding in our design solutions.

Creating together involves carving out space and freedom to collaborate routinely. Team members are seldom sitting at their desks, heads down, sweating through a problem alone. Instead, we establish a war room to centralize our focus on solving the small and large challenges that arise.

REDUCING FRICTION

Helping save vital time for educators.

The designs emerged iteratively based on a never-ending loop of user feedback to help deliver a personalized teaching experience based on realistic outcomes. Throughout the year, we interviewed instructors across many different disciplines using both in-person and remote for feedback at many different stages of discovery research and design delivery.

262

Educators interviewed

30

User research studies

2

Patents pending
OPTIMIZING SOLUTIONS

Finding the right cadence

Lean UX is difficult for many who want sharp, pixel-perfect designs from the get-go, but the process motivated our team to shape useful ideas on a tight timeline.

Zach Kulpa IE Design Assets14
LEANING ON SHARED UNDERSTANDING
Zach Kulpa IE Design Assets12

The advantage of pushing ourselves in a collaborative gathering to get a pulse from our uers rapidly is an easy trade-off compared to the taxing stress of dreaming up killer ideas in a vacuum with no measurement of usability and handing off waterfall designs to development. Maintaining the constant feedback loop as a team with Instructors actually takes the weight off our shoulders. It frees our collective mind to better solutions to REAL problems.

The sprint cycles encapsulate their own stressors. We're accountable for determining what to solve, how to solve it, and building out a testable prototype flow for eagle-eyed college professors in a week. It can be fast-paced, but we're tackling problems head-on, and the impact is tangible. It's vital to seek out the delicate balance of creative openness to encourage wild ideas along with accountability for the team to get anything on the page.

Zach Kulpa IE Design Assets5

 

PRIME LESSONS:
  • Ensured direct validation from our partners and stakeholders

  • Incorporated research during iterative validation stages

  • Revealed workflows that work best for time-strapped instructors

  • Addressed details that might not have surfaced until initial release

  • Infused assurance that we're answering customer future needs

Modal-Struggling-list-level1nobg@2x
challenging
complete
Modal-Struggling-email-expandednobg@2x
Modal-Low-activity-list-level1nobg@2x
ready
challenging-questions
default
GUIDING OUTCOMES W/ INSIGHTS

It was imperative to present instructors with essential details they need most. The grades view clearly flags vital information about student performance and content to possibly review in the next classroom session with students.

The assessment detail pages highlight class-wide performance and knowledge gaps, including questions that the students found challenging based on 'correct on first-try' calculations. These deep dive detail pages concentrate on overall score and assignment progress along with scannable learning outcomes.

Modal-Struggling-list-level1nobg@2x
DATA POINTS THAT LEAD TO OUTCOMES

Actionable info

We presented instructors with details about students who are struggling with specific content to cover in class or students who aren't completing designated work. These details are progressively offered at three different levels, including varied timeframe filters.

USING INSIGHTS TO TAKE ACTION

Ongoing lessons

Throughout the experience, a direct messaging system allows the instructor to reach out to particular students about their grades and submissions - including batch emails to struggling cohorts.

Modal-Struggling-email-expandednobg@2x
Zach-Kulpa-IE-Assignment-Details-Screen_Macbook_x2
THOUGHTFUL ENHANCEMENTS

The reimagined gradebook surfaces essential grade statistics associated with each assignment. The improved flagging system highlights student submissions that need to be graded along with challenging content to be evaluated and possibly incorporated into a lesson during an upcoming class.

Visual design implemented throughout the process:

  • Automatic & straightforward: Easy to learn and use
  • Practical & helpful: Enabling information design
  • Actionable insights: Meaningful use of color
  • Simple visualizations: See what's important
Zach-Kulpa-IE-Multi-Unboxing_transp_x2
THE RESULTS

Part 3: Outcome

 

What were the initial lessons learned?
SHIPPING EARLY

Move & Improve

Adopting the Lean UX design process gave our team autonomy to better understand problems. We uncovered and solved for real user pain points.

Zach-Kulpa-IE-DB-Visual-Refresh-Screen_iMac_x2
WHAT WERE THE BIG LESSONS?
Zach-Kulpa-IE-Design-Assets13

From start to finish, the inclusive and collaborative design methods enabled our team to study the problem inside and out, examine various ideas, fail quickly, and iterate to serve the customer and the always-evolving classroom.

As cross-functional partners, we worked quickly and collaboratively to get something, anything, in front of the user for validation as early as possible.

This is how we strengthened and delivered innovations to help users identify:

  • Struggling Students:
    • Answering the question: "Who is struggling in class?"

    • Quickly identify which students are having a hard time with specific material or other who aren't completing homework

  • Challenging Content:
    • Answering the question: "What content is difficult?"
    • Class-wide performance, time spent, & questions answered

We eliminated deliverable waste and steered toward the most basic MVP for testing to fuel continuous discovery. Our rapid learning cycle outfitted the team with info to better adapt and respond w/ change to provide true value.

Zach-Kulpa-IE-Multi-Visual-Refresh_x2

"It's good feedback if I want to ask a student 'what's up?' We want to contact students that are falling behind, so this would be extremely useful."

svg-image
Sociology instructor
APPROACHES TO WAYS OF WORKING

Clear comms

Collaborating early with developers on potential solutions would bring a technical perspective to our solutions, which would help to inform new ways to solve problems based on the art of the possible and feasibility limits.
Zach Kulpa IE Design Assets8

"Feels like a modern piece of technology. Not only is it data-driven, but it's user friendly. The interface is clearly direct, so it's not intimidating."

svg-image
English instructor
THE DAY-TO-DAY

Part 4: Behind-the-scenes

 

How did we have fun along the way and keep the creativity flowing when solving complex problems?

Keep it light

Throughout the design process our team was named 'HMS Belafonte' and many collab sessions were themed by the intrepid spirit Steve Zissou exuded throughout 'The Life Aquatic.' Below is a sampling of our collab session decks.

Zach-Kulpa-Pearson-Belafonte-1
Zach-Kulpa-Belafonte-Asset-5
Zach-Kulpa-Belafonte-Asset-1
Zach-Kulpa-Belafonte-Asset-11
Zach-Kulpa-Belafonte-Asset-10
Zach-Kulpa-Belafonte-Asset-13
Zach-Kulpa-Belafonte-Asset-2

Have ideas? Say hi!

Let's build something impactful together.