AI-driven Warehouse Operations Platform

AI-driven Warehouse Operations Platform

.Client

Alibaba Group

.My Role

UX Design, Product Design.

.Our Users

Support Associate, Order Picker, Inventory Control Specialist.

.Timeline

06.2024-09.2024, Launched 11.2024

.Team

YueYang - PM
BaoWang - Product Leader
QianNing - Engineer
ShiLang- Engineer
Rengqi Han- Data Scientist

.Overview

Warehouse operations were inefficient, with field efficiency constrained by outdated workflows on the digital platform. To address this, Alibaba sought an AI-driven solution leveraging digital interactions to boost productivity. This smart warehouse platform empowers workers, enhances efficiency, and lowers warehouse costs.

01

Context

Reimagine warehouse operations with a system that’s intuitive, efficient, and seamlessly integrated.

A warehouse of 180,000 square feet loses an average of 20 items daily, leading to increased company costs.

Low-efficiency workflows force the company to hire a large number of employees to meet high-volume order fulfillment demands.

Low-efficiency workflows force the company to hire a large number of employees to meet high-volume order fulfillment demands.

A warehouse of 180,000 square feet loses an average of 20 items daily, leading to increased company costs.

02

Problem

To build domain knowledge and identify key challenges, opportunities, and relevant stakeholders, we carried out 29 on-site interviews.

Through interviews with workers in various warehouse roles, we prioritized key issues and identified that the inefficiencies faced by Inventory Control Specialists, Order Pickers, and Support Associates can be effectively addressed through a platform-based system.

Inventory Control Specialist

I maintain shelf organization and reconcile physical stock with system records.

I maintain shelf organization and reconcile physical stock with system records.

Order Picker

I retrieve items from shelves based on customer orders .

I retrieve items from shelves based on customer orders .

Time-Consuming Item Recovery

Slow Item Picking

Slow Item Picking

Slow Item Picking

Support Associate

I handle reported exceptions, such as missing stock or wrong items picked.

I handle reported exceptions, such as missing stock or wrong items picked.

The problem is encountered by all three roles

PC Window Overload

Communication Costs

Communication Costs

03

Field Research

To understand the core reasons behind these problems, we conducted a deep dive into field operations.

I led in-depth interviews with 9 users across three key roles—Support Associate, Inventory Control Specialist, and Order Picker.

Due to the unique nature of on-site operations, it was difficult to uncover all key issues through communication alone.

I facilitated task-driven research immersive roleplays to observe real operational habits of three key stakeholders, formulate hypotheses about the core probelms, and develop initial design solutions. This approach provided actionable insights for further refinement.

Insights

01

We found slow item picking is impacted by Inefficient routes and fixed visual focus which caused Pickers to overlook items in less prominent areas.

02

We found time-consuming item recovery is caused by Improper Picking and lack of information.

03

Communication is challenging in large warehouses, but most issues can be resolved through standard guidelines. High employee turnover leaves many unfamiliar with these procedures.

04

The PC window is overloaded due to multiple pages being opened and frequently referenced.

How to win strategy

01

From habitual gaze to intentional redirection

02

From aimless searching to a potential informed exploration

From aimless searching to a potential informed exploration

From aimless searching to a potential informed exploration

03

From time-consuming clarifications to instant AI insights

04

From overloaded toggling to streamlined split-screen views

From overloaded toggling to streamlined split-screen views

From overloaded toggling to streamlined split-screen views

04

User Test

To validate hypothesis and assess whether the features were suitable for warehouse operations, I conducted user tests prior to creating the wireframe.

Research Question and Metrics: How much distance can optimized routes cut? How much time can location prompts save? Is voice input suitable for warehouses?

Findings

01

Optimal and inefficient routes differ by over 500 meters in running distance.

02

Reducing visual scanning significantly accelerates item searching.

03

Voice input is a suitable modality for warehouse operations.

05

Wireframe

Based on the research insights above, I developed a solution strategy and outlined the core product MVP, which led to the creation of the wireframe.

Cross-platform synchronization for consistent user experience between mobile and PC interfaces.

06

Retrospective

I facilitated three retrospectives with experts from different fields — UX, Data, and PM.

I presented my research findings and design solution, aiming to design from the core problem. However, engineers cited limited resources, suggesting starting with simple features while anticipating AI product execution next quarter.

Takeaway

Reschedule Design Hierarchy

We prioritized addressing core issues while balancing resource constraints, opting for a phased approach: optimize with split-screen support and design improvements, then redesign with intelligent features, and finally explore conceptual innovations.

Incorporate design considerations and balance technical constraints to build impactful and practical solutions.

Incorporate design considerations and balance technical constraints to build impactful and practical solutions.

Speculative thinking for the AI product

Speculative thinking for the AI product

Design considerations:

  • Response logic and behavior

  • Generation of visionary solutions

  • Input information

  • Response speed

Design considerations:

  • Response logic and behavior

  • Generation of visionary solutions

  • Input information

  • Response speed

Feasibility of solutions

Feasibility of solutions

Feasibility of solutions

Technical constraints:

  • Data structure

  • Performance

Technical constraints:

  • Data structure

  • Performance

07

Iteration

Solution 1 - Optimized Interface

I redesigned Interfaces and optimized workflow for on-site item retrieval.

Eye-Level Guidance: Enhances navigation by quickly pinpointing specific shelf positions.

Optimal Path Planning: Reduces detours with efficient pick routes and order sequencing.

MR Integration: Combines 2D and MR navigation to adapt to different situations.

MR Integration: Combines 2D and MR navigation to adapt to different situations.

Solution 2 - AI filter

I designed a cloud voice library that enables pickers to upload anomaly reports via voice, accessible to associates on PC and mobile. AI search efficiently retrieves clues, transforming individual guesswork into collaborative problem-solving .

Fast and Accurate AI Filtering: AI quickly identifies relevant clues, improving efficiency.

State Tracking: Marks used clues as "checked," avoiding redundant searches and saving time.

State Tracking: Marks used clues as "checked," avoiding redundant searches and saving time.

Field Access: On-site voice library access enables real-time adjustments for better item retrieval.

Mobile Updates: Streamlines operations without requiring a computer.

Mobile Updates: Streamlines operations without requiring a computer.

Solution 3 - Gen AI

I designed a mobile version of ChatAI, extending its functionality from the PC.

Flexible Input: Supports voice, shelf QR codes, and text as prompts, saving input time.

Mobile AI: Migrated AI solutions from PC to intuitive mobile interfaces, reducing repetitive communication during lengthy warehouse routes.

Mobile AI: Migrated AI solutions from PC to intuitive mobile interfaces, reducing repetitive communication during lengthy warehouse routes.

08

Integration

To enhance ChatAI's capability as a versatile internal tool for various business units, I addressed integration challenges across teams.

I collaborated with technical teams to develop a universal design pattern but faced issues like data security concerns and siloed management between overseas and local teams.
To resolve this, I designed three card solutions: a comprehensive option requiring broader data permissions and collaboration, and a basic option for teams preferring minimal resource and data involvement.

The three bundles offer flexibility tailored to team preferences and resource commitments.

09

Takeaways

A framework for field operation AI products


focusing on addressing on-site challenges with scalable and efficient solutions.

.Anna-Yangqiuzi Zhang

.Anna-Yangqiuzi Zhang

menu

.Anna-Yangqiuzi Zhang

.Anna-Yangqiuzi Zhang