top of page

Search Re Design

Improve website search relevance by 60% and empower sales with faster, smarter results

Overview

The Search Re-Design project focused on transforming NetCom Learning’s CMS search into a tool that is fast, relevant, and scalable. By integrating ElasticSearch, introducing semantic ranking, adding intuitive filters, and enabling built-in feedback, we delivered a system that not only improved accuracy but also empowered sales teams with confidence during customer interactions. The redesign created a future-ready search framework, balancing performance, usability, and continuous optimization.

My Role

As Product Manager & UX Designer, I led the redesign of our CMS search experience, partnering with engineering and sales stakeholders. My role spanned problem discovery, ux design, usability testing, semantic search integration with ElasticSearch, and building a scalable framework for ongoing optimization.
 

This was both a technical challenge (integrating semantic + keyword search) and a user experience challenge (delivering confidence during live customer interactions).

Collaborating team

Cross‑functional squad across Product, Engineering, QA, Marketing, Vendor Course Management and Sales Team

Research Methods

Stakeholder interviews, Search relevancy audits, Usability audits, Technology capability

Problem 

Search is one of the most critical features of NetCom Learning  Website  — yet, it was failing both users and the business.

For Sales Teams

Search failed during client demos—users couldn’t find courses quickly, causing poor experience and lost opportunities.

For Customers

Irrelevant or “no results” outcomes reduced confidence in the platform.

For the Business

Low search performance directly impacted lead conversion and sales efficiency.

Core Issues Identified:

Irrelevant Results

The old SwiftType search relied on simple keyword matching. Contextual queries failed.

No Filters or Refinement

Users had no way to narrow results by vendor, product, or category.

“No Results” Dead Ends

Queries often returned empty results even if relevant content existed.

No Feedback Mechanism

Sales had no easy way to report poor results, so tuning was reactive, not continuous.

Poor Demo Readiness

Inconsistent performance meant search couldn’t be trusted in front of customers.

I asked important question at beginning: How to improve search relevance in Elasticsearch? Why is my site search inaccurate?

Research & Insights

I conducted in-depth sessions with the Sales team and Learning Consultants, alongside UAT rounds. The key insights were:

Insight 1 — Relevance and ranking were inconsistent

Pain Point: Common keywords (“Excel course”) returned irrelevant results.

Solution: Semantic understanding of context, not just keyword matching.

Outcome: Adopted ElasticSearch with semantic + keyword hybrid ranking.

Search results 1920-1440_01 – 3.jpg

Insight 1 — Feedback loop was missing during UAT

Pain Point: Team couldn’t easily flag bad search results during UAT. Feedback relied on email/Jira ticket, so data was lost. Team were not interested in raising Jira Ticket

Expectation: A built-in way to provide feedback directly within search for the search fine tuning. We designed a feedback capture tool tied to ElasticSearch to continuously refine relevance during UAT.

Outcome: Gathered feedback which paved a way to build the Keyword Boosting Tool to improve relevancy.

UAT feedback form.png

Insight 3 — Filters were ineffective and missing 

Pain Point: Filters only worked for limited cases (Courses, Certifications, Blogs etc), offering no meaningful refinement.

Expectation: Rich, intuitive filters for vendors, and products to narrow down search results.

Outcome: Introduced multi-dimensional filtering to make narrowing down effortless.

Mobile filter (2).jpg

Insight 4 — Search wasn’t demo-ready

Pain Point: Sales reps hesitated to use search live because results were unpredictable.

Expectation: Polished, consistent search UX that inspires confidence.

Outcome: Refined UI and tuned results until demo-ready standards were met.

Search component states.jpg

Solutions

We transitioned from SwiftType to ElasticSearch with a layered solution:

Structured Data Indexing for Smarter Search

Our first step was to index key course data fields to give the Elasticsearch engine a richer dataset for analysis and better findability. We indexed fields such as the Course Title, Subtitle, Description, Overview, Objectives, Outlines, and Job Role Mapping with the Course allowing Elasticsearch to leverage structured inputs for stronger semantic understanding and keyword matching.
 

Later, we extended this by implementing relationship mapping between courses and related entities including certifications, blogs, webinars, products, vendors, case studies, e-books, and solutions. This relational indexing strengthened the engine’s understanding of content hierarchy and improved search result categorization and relevance for users.

Semantic + Keyword Search

Once the data foundation was in place, we moved to enhance search intelligence using a hybrid semantic and keyword-based model. The initial Elasticsearch setup performed well contextually but produced overly broad results, often missing exact matches. To fix this, our Technical Manager, Abhimanyu Singh, proposed a hybrid search approach combining semantic understanding with keyword-based precision.

This integration balanced contextual relevance with exact keyword accuracy, leading to a more refined search experience. The first version of this hybrid model initiated our UAT phase, where we began to analyze search behavior, measure improvement, and plan further fine-tuning. This also helped me understand about what is Semantic vs keyword search. 

UAT — Boost Value Optimization Tool

During UAT, we needed a way to fine-tune search relevance and control the weightage between semantic and keyword logic. Collaborating with Technical Manager, Abhimanyu Singh, I led the creation of the Boost Value Optimization Tool an internal interface that allowed our Course Management, Sales, and Marketing teams to adjust semantic and keyword weights for different course fields such as title, subtitle, description, details, outline, and job roles.
 

Teams could test various combinations (e.g., increasing keyword weight for “course title” or reducing semantic influence for “description”) to bring relevant results to the top. We collected data for 60+ high-priority keywords, averaged the effective boost values per field, and applied them to Version 1 of the search engine. This iteration produced noticeably better ranking accuracy and relevance consistency, validating our hybrid tuning model. Learning how to implement Boost value optimization in Elasticsearch was exciting form me. 

UX Improvements for Enhanced Usability and Experience

Alongside backend improvements, I focused on enhancing the usability of the search tool. My UX analysis revealed major gaps lack of filtering options, absence of auto-suggestions, no voice search capability, and limited responsiveness across devices. Moreover, weak mapping between categories like courses, certifications, and blogs often led to “No Results Found” errors for over 80% of keywords.
 

To resolve this, I redesigned the search interface and flow, introducing robust filters, auto-suggestions, and voice search, while improving mobile responsiveness and overall visual hierarchy. The improved design reduced search errors, enhanced discoverability, and created a more seamless, delightful user experience.

Demonstrations and Continuous Feedback Loop

After implementing the optimized search system, I conducted live demonstrations with key stakeholders across Course Management, Sales, Marketing, and Technology teams. The goal was to validate improvements, showcase results, and encourage active participation in further refinement.
 

Stakeholders were invited to test keywords, report any relevancy issues, and share feedback directly through a continuous improvement channel. This collaborative feedback loop ensured the search tool evolved dynamically maintaining high relevance, user satisfaction, and business alignment over time.

Implementation Challenges

Implementing a comprehensive search optimization initiative came with multiple challenges across data integrity, collaboration, system performance, and user feedback. Each phase revealed valuable lessons that helped refine the process and improve overall solution maturity.

Data Inconsistency and Structure Gaps

Early in the process, we discovered inconsistencies in course data formatting — especially across titles, descriptions, and outlines. This inconsistency reduced Elasticsearch’s ability to interpret and rank data effectively. To address this, we standardized the data model and restructured key fields before indexing, ensuring cleaner and more reliable input for semantic and keyword analysis.

Balancing Semantic and Keyword Weightage

Determining the right balance between semantic understanding and keyword-based precision was one of the most complex technical challenges. Too much reliance on semantics led to broad, less relevant results, while excessive keyword weighting ignored context. This led to the development of the Boost Value Optimization Tool, which allowed teams to fine-tune field-level weights dynamically and achieve hybrid relevancy.

Balancing Semantic and Keyword Weightage

Determining the right balance between semantic understanding and keyword-based precision was one of the most complex technical challenges. Too much reliance on semantics led to broad, less relevant results, while excessive keyword weighting ignored context. This led to the development of the Boost Value Optimization Tool, which allowed teams to fine-tune field-level weights dynamically and achieve hybrid relevancy.

Cross-Functional Coordination and Delayed Feedback

Collaboration with the Course Management, Sales, and Marketing teams was essential but not always smooth. Feedback cycles were often delayed or lacked clarity, slowing iteration speed. Additionally, we lacked a direct mechanism to capture real user and customer feedback on the website, making it harder to validate improvements in search relevancy. These gaps highlighted the need for a structured feedback collection system integrated with analytics and user behavior tracking for future iterations.

Performance and Scalability Constraints

As relational mapping between entities (courses, certifications, webinars, vendors, etc.) grew, the Elasticsearch engine experienced latency issues during query execution. We optimized the schema design and redefined field priorities to maintain scalability without compromising speed or accuracy.

UX Adoption and Behavioral Change

The redesigned search interface introduced new usability layers — filters, voice search, and auto-suggestions — which required users to adapt to a more guided experience. Through iterative UX testing, user onboarding, and design refinements, we ensured the new experience felt intuitive and value-driven for diverse user groups.

Before & After Comparison

SwiftType (Old)

  • Keyword-only logic: It lacked contextual understanding or semantic depth.
     

  • Irrelevant or inconsistent results due to unstructured course data.
     

  • No relational mapping between courses, certifications, and related assets.
     

  • Limited user control: No filters, no auto suggestions, and no feedback mechanism.
     

  • Frequent “No results found” for over 80% of search queries.
     

  • Low adoption by internal teams: Sales and course managers avoided using it live due to poor reliability.

ElasticSearch (New)

  • Hybrid Semantic + Keyword Search: Balanced contextual relevance with exact match precision.
     

  • Structured Data Indexing — indexed titles, descriptions, objectives, and outlines for smarter search learning.
     

  • Boost Value Optimization Tool — enabled dynamic tuning of field weights and improved ranking accuracy.
     

  • 60% improvement in search relevancy across 2,400+ courses and related entities
     

  • Enhanced UX Layer — added filters, voice search, auto-suggestions, and mobile-friendly design.
     

  • Built-in Feedback Loop — invited cross-functional inputs and user feedback for continuous optimization.
     

  • Demo-ready and trusted in sales calls — transformed search from a weak point into a showcase feature.

Learnings

  • Relevance is never “done”: Search requires continuous iteration, not a one-time rollout.
     

  • Feedback loops drive success: Giving Sales an effortless way to contribute insights created a self-improving system.
     

  • Performance builds trust: Even small latency reductions shaped adoption.
     

  • Empower product teams: The Boost Optimization Tool shifted control from engineering to product, enabling faster tuning cycles.

Future Roadmap

  • Natural Language Query Support: Conversational, human-like queries
     

  • Search Analytics Dashboards: CTR, zero-result queries, conversion tracking via Kibana.
     

  • Regional Optimization: Fine-tuning for India, Bangladesh, and other global markets.
     

  • Integration with all apps in an Ecosystem : Rollout across all apps in an Ecosystem

Improve your product’s search experience

If your users struggle to find what they need, I can help you audit and redesign your search UX, from ElasticSearch relevance to filters and results UI.

bottom of page