Senior Search Evaluation Analyst

  • Location SAN BRUNO, CA
  • Department -
  • Team Search
  • Employment Type -
  • Position -
  • Requisition GH1679504

What you'll do at

Senior Search Evaluation Analyst

Are you an avid researcher who is passionate about language and relevance? Do you thrive on analyzing search data patterns for large-scale search engines? If so, WalmartLabs’ Search Evaluation team has an immediate opening for a Senior Search Evaluation Analyst in our Sunnyvale office.  As part of the Search Evaluations team, you will represent the user’s perspective as you suggest and test new features being introduced to Walmart Grocery.  Your day-to-day responsibilities will include creating evaluations to test new search features, designing A/B test methods, reading into data to give feedback on important user experience issues, as well as a multitude of other tasks designed to keep the Search Relevance team running smoothly.


  • Collaborate with Product Managers and Engineers on how to evaluate new search and browse features and provide feedback on improvements and regressions
  • Use query logs, user data, and statistical methods to uncover relevance issues and share with the relevance team
  • Analyze judgments and identify patterns from rating generated by expert raters offsite
  • Work closely with the tools team to identify inefficiencies within the team and brainstorm new tools improvements to streamline them


  • 2-3 years of experience in search editing, research, A/B testing or other similar field
  • Prior experience with relevance ranking or scoring of computer applications
  • Strong statistical and data analysis skills
  • Well developed analytical skills, including experience analyzing large data sets; comfortable generating reports that identify patterns and other key issues
  • Demonstrated ability to solve complex problems with minimal input
  • Comfortable working with cross-functional teams, Product/ Engineers/ Data Scientists who build complex search queries and algorithms
  • Persistent, results-driven attitude with a dedication to maintaining the highest level of quality
  • Strong communication skills
  • Bachelor’s degree or equivalent experience with strong stats or analytics focus


  • Strong background in designing multiple types of relevance tests or search quality evaluations
  • Prior experience in eCommerce and Grocery eCommerce a plus
  • Experience working with project management tools such as JIRA, Confluence, testing tools

About the Retail Core Engine Team

As the nucleolus to the Walmart eCommerce shopping experience, the Retail Core Engine is dedicated to solving complex and exciting challenges that will redefine the ecommerce experience and empower shoppers.   As a leader of the item product team, you will define and drive solutions that influence the behavior of our customers.  Each solution is an opportunity to drive value and design features that affect millions of customers shopping at Walmart each day.  Our agile team collaborates with the engineering and business stakeholders to maintain and nurture roadmaps that define an experience from supplier to customer.

About Walmart US eCommerce

Walmart U.S. eCommerce is comprised of,, Hayneedle,, Moosejaw, VUDU, ModCloth & Bonobos. Here, innovators incubate next gen e-commerce solutions in real-time. We integrate online, physical, and mobile shopping experiences for billions of customers around the globe. How do we do it? We continuously build and invest in new technology including open source tools and big data innovations. The world's largest retailer is also the world's largest, fastest-growing, and most dynamic ecommerce organization. We are creating a seamless experience that lets customers shop anytime and anywhere using online, mobile, social and stores. Walmart’s mission is to become the smartest way to shop and save on pretty much anything. Combining a revolutionary pricing engine, a world-class technology and fulfillment platform, and incredible customer service, we’ve set out to create a new kind of e-commerce.



The Walmart US eCommerce team is rapidly innovating to evolve and define the future state of shopping. As the world’s largest retailer, we are on a mission to help people save money and live better. With the help of some of the brightest minds in merchandising, marketing, supply chain, talent and more, we are reimaging the intersection of digital and physical shopping to help achieve that mission.

Recently viewed jobs