UX Research

InstaCart - Case study

My Role
UX Research
User Testing
Timeline
Sep 2023-Oct 2023

Introduction

Instacart is a grocery delivery and pickup service app, connecting users with personal shoppers who handpick items from local stores and deliver them directly to the user's doorstep. The platform partners with various grocery chains, allowing users to shop from a wide range of products, schedule delivery times, and even chat with shoppers in real-time. Offering a convenient solution for busy individuals, Instacart emphasizes a seamless shopping experience from the comfort of one's home.

Why Instacart?

We aimed to select an application with a high rate of recurring usage, one that users return to every month or at least every few months. What could be more fitting than a grocery delivery app? An application that users consistently rely on and use repeatedly. The surging popularity of online grocery platforms, influenced by global shifts and an emphasis on convenience, renders Instacart a prime candidate for usability analysis. Ensuring its design meets evolving user demands is paramount.

  1. User Behavior Analysis: One of the primary goals was to comprehend how users interact with the app, identify the typical user journey, and ascertain any potential pain points or roadblocks they encounter during their shopping process.
  2. Feature Utilization: Understanding which features are most and least utilized by users can give insights into the areas of strength of the application and those that may need refinement.
  3. Market Differentiation: With a myriad of grocery delivery apps available, determining what sets Instacart apart from its competitors in the eyes of its users is crucial. This aids in pinpointing its unique value proposition.
  4. Usability Testing: By observing real-time interactions of users with the platform, the objective was to test the app's usability and identify areas that could enhance user satisfaction and task completion rates.
  5. Feedback Aggregation: Collecting and analyzing feedback can provide direct input from users about desired features, improvements, or elements of the app they find redundant or confusing.
  6. Performance Evaluation: Speed, efficiency, and reliability play a crucial role in digital platforms. Assessing the app's performance across various devices and network conditions was another objective.
  7. Comparative Analysis: By comparing Instacart with its competitors on parameters like UI/UX, feature set, pricing, and service quality, the research aimed to draw a holistic picture of where the app stands in the market.
  8. Future Recommendations: The ultimate goal of the research was not just to evaluate the current state but also to provide actionable recommendations for the future. This encompasses new feature suggestions, UX improvements, and potential expansions or integrations.

My Role

  • Design & Framework: Conceived the study structure, ensuring a well-rounded analysis through both qualitative and quantitative methods.
  • Execution: Spearheaded "Think Aloud" sessions, where real-time user interactions with the app were meticulously observed and documented. Conducted interviews with users to get a deeper understanding of what problems users face and what aspects of the app can be improved.
  • Analysis: Championed the interpretation of the SUS ratings, ensuring every data point was transformed into coherent insights.
  • Feedback Synthesis: Assimilated qualitative feedback, organizing them into discernible themes to guide actionable next steps.

Methods and Data Analysis

  1. Interviews: These exploratory discussions offered preliminary insights, painting a picture of the user's broader experience.
  2. Think Aloud Sessions: Conducted under close observation, these sessions highlighted user navigation pain points, and successes.
  3. SUS Ratings: Deployed the System Usability Scale questionnaire.

Target Users

We are targeting graduate students from the age group of 20-30 years. When we researched (desk research)  before setting up a demographic, we found that most of the participants using the app fall in this age range and are graduate students.

User Personas

User Persona - 1
User Persona - 2

Interviews

We carefully selected a diverse group of international students for our interviews based on demographic data. Our goal was to deeply explore how international students perceive and use Instacart, considering various factors that might influence their experiences. We engaged with international students with different levels of familiarity with Instacart, ranging from frequent users to newcomers, and considered their cultural backgrounds, academic majors, and the duration of their stay in the United States.

Check out the interview questions here.

Interview Findings

Strengths:

  • Bulk & Recipe Features: Users appreciate these for streamlined cart management.
  • Promotions: First three deliveries are free for new users; Instacart+ is favored for waiving delivery fees.
  • Variety: Access to multiple stores is a plus.
  • Convenience & Time-saving: Valued by international students, especially for bulky or temperature-sensitive items.

Improvement Areas:

  • UI: Scrolling challenges and better onboarding for new users.
  • Ordering & Delivery: Concerns over product replacements, delivery accuracy, and return/refund processes.
  • Cart Management: A desire for a more unified cart experience across stores.
  • Features: Requests for financial tracking, increased personalization, post-order flexibility, and integrations like Splitwise.
Affinity Mapping

Affinity mapping is a collaborative technique used to organize and synthesize the vast amounts of unstructured data gathered from interviews. By visually clustering similar ideas and insights, it aids in discerning patterns, identifying overarching themes, and pinpointing areas of concern or opportunity. This method not only ensures a holistic understanding by combining different perspectives but also reduces individual biases, making insights more grounded and actionable. In essence, affinity mapping transforms raw, qualitative data into clear, visual representations that can guide subsequent decisions and strategies.

Affinity Cards
Affinity Mapping
Codes

Codes in UX search are essential for several key reasons. They help organize and categorize large amounts of qualitative data, making it manageable. These codes also serve as the foundation for data analysis, allowing researchers to identify trends and insights in user behavior and preferences. Additionally, codes provide a standardized language for data interpretation and facilitate communication among team members and stakeholders.

Think Aloud Session

We conducted a survey to understand the demographics of online grocery shoppers and found Instacart to be a predominant choice among them. Through Think Aloud sessions with 10 diverse users, primarily representing the 20-30 age bracket of graduate students, we delved into common challenges faced during their app usage. This targeted demographic was chosen based on our initial desk research, which indicated that a significant portion of the app's users were graduate students within this age range.

Tasks
  1. Finding and Adding Items to Cart - You are cooking spaghetti aglio-olio for which you need a few ingredients. The ingredients are - spaghetti, jalapenos, oregano, chilli flakes and garlic. Search for the ingredients and add those to the cart from the Kroger store from Instacart - App.
  2. Comparing the Price of a Product across different stores - You want to order Gala apples, but you need more cash so you have to order from the cheapest vendor on the Instacart - App. Compare prices of the apples available in different stores and add the most affordable available option in the cart.
Think Aloud Findings

User Experience Issues with Instacart App:

  1. Burdensome Efforts: Numerous steps required for price comparison and product searches.
  2. Slow Loading: Excessive loading times during product searches.
  3. Unclear Product Descriptions: Presence of confusing tags; absence of dietary information (veg/non-veg/vegan).
  4. Inefficient Search: Unrelated product suggestions; no memory of recent searches.
  5. Lack of Personalization: Frequently bought items and best-sellers not prioritized; need to scroll extensively for common items.
  6. Location Issues: Closer stores not prioritized in listings, affecting delivery preferences.
  7. Vague Information: Ambiguous quantity descriptions for fresh produce and packaged items.
  8. Price Comparison Difficulties: Prices absent from search results, necessitating individual store checks.
  9. Misleading Stock Indicators: Ambiguity with the "Likely out of stock" label.
  10. Inadequate Promotion Highlight: Discounts and marketing not prominently displayed.
Task Success Rate

SUS Rating

We conducted SUS Rating with our 10 participants. We gathered the data and used that data to analyze and understand the perception of different users and how different users rate the application. The SUS rating refers to the System Usability Scale. It provides a quantitative measure of usability and user satisfaction. Higher SUS scores indicate better usability and user satisfaction.

SUS Rating Findings

In this study using the System Usability Scale (SUS), participants assessed Instacart-App’s usability, revealing a mix of strengths and areas for improvement. A key concern raised by multiple participants was the application's perceived complexity, which they found unnecessarily intricate. This indicates a need to simplify the user interface and interactions, as complexity can discourage user adoption and lead to frustration.

Participants also noticed inconsistencies in the application's design and functionality, highlighting the importance of design and interaction consistency for a smooth user experience. Inconsistencies can confuse users and inhibit efficient navigation. Furthermore, the participants expressed the need for assistance when using the application, suggesting room for improvement in the user experience to enable more self-guided navigation and reduce reliance on external help.

Check the complete calculation here.

Participant Data
SUS Rating Calculation

1. Streamlined Interface: Simplifying the design can directly improve user experience and retention. Reduce design clutter and prioritize core functions to enhance user navigation and decision-making.

2. Design Consistency: Uniform design elements prevent confusion. Adhere to a consistent design language, including consistent icons, buttons, and color schemes across the app.

3. Performance Optimization: Slow app performance can deter users. Implement back-end and front-end optimizations, focusing on areas highlighted by user feedback, such as search and load times.

4. Enhanced Price Comparison: Comparative shopping is a key user expectation. Offer a feature that shows comparative prices from different stores for a chosen product, allowing informed decisions without extensive navigation.

5. Personalized Shopping Experience: Enhancing user convenience can foster loyalty. Introduce a "Repeat Last Order" option and use algorithms to suggest products based on user behavior and preferences.

6. Real-time Communication: Direct communication can improve user satisfaction. Integrate a chat feature for users to interact with delivery personnel, aiding in better order accuracy and coordination.

7. Prominent Promotions: Users seek value deals. Position offers and deals at strategic locations in the app, like the homepage, ensuring visibility.

8. Efficient Checkout Process: A simplified checkout can enhance conversions. Refine the checkout flow, reducing unnecessary steps and offering an express option for frequent users.

Next Steps

Next Steps in the Research and Evaluation Process:

1. Prototyping: Based on the recommendations, create low-fidelity prototypes to visualize the proposed changes. Tools like Sketch, Figma, or Adobe XD can be used for this phase.

2. User Testing on Prototypes: Conduct usability tests on the prototypes with a small group of users to validate the proposed changes. This will help identify any potential problems before development begins.

3. Feedback Integration: Analyze the results from the prototype testing and refine the design accordingly. Address any new pain points or challenges that emerge.

4. High-Fidelity Design: Progress to high-fidelity designs that incorporate detailed visual and interaction elements. These designs should be a close representation of the final product.

5. Development Collaboration: Work closely with the development team to ensure that the designs are implemented accurately. Regular check-ins will be crucial to align design intent with technical feasibility.

6. Beta Testing: Once the changes are developed, launch a beta version of the application. Invite a subset of users to test this version in real-world scenarios and provide feedback.

7. Iteration: Using feedback from the beta testing, make any necessary refinements to enhance functionality and user experience.

8. Continuous Monitoring & Feedback Loop: Establish mechanisms for ongoing user feedback collection, like analytics tracking and periodic surveys. This ensures you're always attuned to user needs and can respond with timely updates.

By following these steps, we'll ensure a thorough and iterative approach to refining and enhancing the Instacart user experience, grounded in real user feedback and rigorous testing.