Search Re Design
Improve website search relevance by 60% and empower sales with faster, smarter results
Overview
The Search Re-Design project focused on transforming NetCom Learning’s CMS search into a tool that is fast, relevant, and scalable. By integrating ElasticSearch, introducing semantic ranking, adding intuitive filters, and enabling built-in feedback, we delivered a system that not only improved accuracy but also empowered sales teams with confidence during customer interactions. The redesign created a future-ready search framework, balancing performance, usability, and continuous optimization.
My Role
As Product Manager & UX Designer, I led the redesign of our CMS search experience, partnering with engineering and sales stakeholders. My role spanned problem discovery, ux design, usability testing, semantic search integration with ElasticSearch, and building a scalable framework for ongoing optimization.
This was both a technical challenge (integrating semantic + keyword search) and a user experience challenge (delivering confidence during live customer interactions).
Collaborating team
Cross‑functional squad across Product, Engineering, QA, Marketing, Vendor Course Management and Sales Team
Research Methods
Stakeholder interviews, Search relevancy audits, Usability audits, Technology capability

Problem
Search is one of the most critical features of NetCom Learning Website — yet, it was failing both users and the business.
For Sales Teams
Search failed during client demos—users couldn’t find courses quickly, causing poor experience and lost opportunities.
For Customers
Irrelevant or “no results” outcomes reduced confidence in the platform.
For the Business
Low search performance directly impacted lead conversion and sales efficiency.
Core Issues Identified:
Irrelevant Results
The old SwiftType search relied on simple keyword matching. Contextual queries failed.
No Filters or Refinement
Users had no way to narrow results by vendor, product, or category.
“No Results” Dead Ends
Queries often returned empty results even if relevant content existed.
No Feedback Mechanism
Sales had no easy way to report poor results, so tuning was reactive, not continuous.
Poor Demo Readiness
Inconsistent performance meant search couldn’t be trusted in front of customers.
I asked important question at beginning: How to improve search relevance in Elasticsearch? Why is my site search inaccurate?
Research & Insights
I conducted in-depth sessions with the Sales team and Learning Consultants, alongside UAT rounds. The key insights were:
Insight 1 — Relevance and ranking were inconsistent
Pain Point: Common keywords (“Excel course”) returned irrelevant results.
Solution: Semantic understanding of context, not just keyword matching.
Outcome: Adopted ElasticSearch with semantic + keyword hybrid ranking.

Insight 1 — Feedback loop was missing during UAT
Pain Point: Team couldn’t easily flag bad search results during UAT. Feedback relied on email/Jira ticket, so data was lost. Team were not interested in raising Jira Ticket
Expectation: A built-in way to provide feedback directly within search for the search fine tuning. We designed a feedback capture tool tied to ElasticSearch to continuously refine relevance during UAT.
Outcome: Gathered feedback which paved a way to build the Keyword Boosting Tool to improve relevancy.

Insight 3 — Filters were ineffective and missing
Pain Point: Filters only worked for limited cases (Courses, Certifications, Blogs etc), offering no meaningful refinement.
Expectation: Rich, intuitive filters for vendors, and products to narrow down search results.
Outcome: Introduced multi-dimensional filtering to make narrowing down effortless.
.jpg)
Insight 4 — Search wasn’t demo-ready
Pain Point: Sales reps hesitated to use search live because results were unpredictable.
Expectation: Polished, consistent search UX that inspires confidence.
Outcome: Refined UI and tuned results until demo-ready standards were met.

Solutions
We transitioned from SwiftType to ElasticSearch with a layered solution:
Structured Data Indexing for Smarter Search
Our first step was to index key course data fields to give the Elasticsearch engine a richer dataset for analysis and better findability. We indexed fields such as the Course Title, Subtitle, Description, Overview, Objectives, Outlines, and Job Role Mapping with the Course allowing Elasticsearch to leverage structured inputs for stronger semantic understanding and keyword matching.
Later, we extended this by implementing relationship mapping between courses and related entities including certifications, blogs, webinars, products, vendors, case studies, e-books, and solutions. This relational indexing strengthened the engine’s understanding of content hierarchy and improved search result categorization and relevance for users.
Semantic + Keyword Search
Once the data foundation was in place, we moved to enhance search intelligence using a hybrid semantic and keyword-based model. The initial Elasticsearch setup performed well contextually but produced overly broad results, often missing exact matches. To fix this, our Technical Manager, Abhimanyu Singh, proposed a hybrid search approach combining semantic understanding with keyword-based precision.
This integration balanced contextual relevance with exact keyword accuracy, leading to a more refined search experience. The first version of this hybrid model initiated our UAT phase, where we began to analyze search behavior, measure improvement, and plan further fine-tuning. This also helped me understand about what is Semantic vs keyword search.
UAT — Boost Value Optimization Tool
During UAT, we needed a way to fine-tune search relevance and control the weightage between semantic and keyword logic. Collaborating with Technical Manager, Abhimanyu Singh, I led the creation of the Boost Value Optimization Tool an internal interface that allowed our Course Management, Sales, and Marketing teams to adjust semantic and keyword weights for different course fields such as title, subtitle, description, details, outline, and job roles.
Teams could test various combinations (e.g., increasing keyword weight for “course title” or reducing semantic influence for “description”) to bring relevant results to the top. We collected data for 60+ high-priority keywords, averaged the effective boost values per field, and applied them to Version 1 of the search engine. This iteration produced noticeably better ranking accuracy and relevance consistency, validating our hybrid tuning model. Learning how to implement Boost value optimization in Elasticsearch was exciting form me.
UX Improvements for Enhanced Usability and Experience
Alongside backend improvements, I focused on enhancing the usability of the search tool. My UX analysis revealed major gaps lack of filtering options, absence of auto-suggestions, no voice search capability, and limited responsiveness across devices. Moreover, weak mapping between categories like courses, certifications, and blogs often led to “No Results Found” errors for over 80% of keywords.
To resolve this, I redesigned the search interface and flow, introducing robust filters, auto-suggestions, and voice search, while improving mobile responsiveness and overall visual hierarchy. The improved design reduced search errors, enhanced discoverability, and created a more seamless, delightful user experience.
Demonstrations and Continuous Feedback Loop
After implementing the optimized search system, I conducted live demonstrations with key stakeholders across Course Management, Sales, Marketing, and Technology teams. The goal was to validate improvements, showcase results, and encourage active participation in further refinement.
Stakeholders were invited to test keywords, report any relevancy issues, and share feedback directly through a continuous improvement channel. This collaborative feedback loop ensured the search tool evolved dynamically maintaining high relevance, user satisfaction, and business alignment over time.
Implementation Challenges
Implementing a comprehensive search optimization initiative came with multiple challenges across data integrity, collaboration, system performance, and user feedback. Each phase revealed valuable lessons that helped refine the process and improve overall solution maturity.
Data Inconsistency and Structure Gaps
Early in the process, we discovered inconsistencies in course data formatting — especially across titles, descriptions, and outlines. This inconsistency reduced Elasticsearch’s ability to interpret and rank data effectively. To address this, we standardized the data model and restructured key fields before indexing, ensuring cleaner and more reliable input for semantic and keyword analysis.
Balancing Semantic and Keyword Weightage
Determining the right balance between semantic understanding and keyword-based precision was one of the most complex technical challenges. Too much reliance on semantics led to broad, less relevant results, while excessive keyword weighting ignored context. This led to the development of the Boost Value Optimization Tool, which allowed teams to fine-tune field-level weights dynamically and achieve hybrid relevancy.
Balancing Semantic and Keyword Weightage
Determining the right balance between semantic understanding and keyword-based precision was one of the most complex technical challenges. Too much reliance on semantics led to broad, less relevant results, while excessive keyword weighting ignored context. This led to the development of the Boost Value Optimization Tool, which allowed teams to fine-tune field-level weights dynamically and achieve hybrid relevancy.
Cross-Functional Coordination and Delayed Feedback
Collaboration with the Course Management, Sales, and Marketing teams was essential but not always smooth. Feedback cycles were often delayed or lacked clarity, slowing iteration speed. Additionally, we lacked a direct mechanism to capture real user and customer feedback on the website, making it harder to validate improvements in search relevancy. These gaps highlighted the need for a structured feedback collection system integrated with analytics and user behavior tracking for future iterations.
Performance and Scalability Constraints
As relational mapping between entities (courses, certifications, webinars, vendors, etc.) grew, the Elasticsearch engine experienced latency issues during query execution. We optimized the schema design and redefined field priorities to maintain scalability without compromising speed or accuracy.
UX Adoption and Behavioral Change
The redesigned search interface introduced new usability layers — filters, voice search, and auto-suggestions — which required users to adapt to a more guided experience. Through iterative UX testing, user onboarding, and design refinements, we ensured the new experience felt intuitive and value-driven for diverse user groups.
Before & After Comparison
SwiftType (Old)
-
Keyword-only logic: It lacked contextual understanding or semantic depth.
-
Irrelevant or inconsistent results due to unstructured course data.
-
No relational mapping between courses, certifications, and related assets.
-
Limited user control: No filters, no auto suggestions, and no feedback mechanism.
-
Frequent “No results found” for over 80% of search queries.
-
Low adoption by internal teams: Sales and course managers avoided using it live due to poor reliability.
ElasticSearch (New)
-
Hybrid Semantic + Keyword Search: Balanced contextual relevance with exact match precision.
-
Structured Data Indexing — indexed titles, descriptions, objectives, and outlines for smarter search learning.
-
Boost Value Optimization Tool — enabled dynamic tuning of field weights and improved ranking accuracy.
-
60% improvement in search relevancy across 2,400+ courses and related entities
-
Enhanced UX Layer — added filters, voice search, auto-suggestions, and mobile-friendly design.
-
Built-in Feedback Loop — invited cross-functional inputs and user feedback for continuous optimization.
-
Demo-ready and trusted in sales calls — transformed search from a weak point into a showcase feature.
Learnings
-
Relevance is never “done”: Search requires continuous iteration, not a one-time rollout.
-
Feedback loops drive success: Giving Sales an effortless way to contribute insights created a self-improving system.
-
Performance builds trust: Even small latency reductions shaped adoption.
-
Empower product teams: The Boost Optimization Tool shifted control from engineering to product, enabling faster tuning cycles.
Future Roadmap
-
Natural Language Query Support: Conversational, human-like queries
-
Search Analytics Dashboards: CTR, zero-result queries, conversion tracking via Kibana.
-
Regional Optimization: Fine-tuning for India, Bangladesh, and other global markets.
-
Integration with all apps in an Ecosystem : Rollout across all apps in an Ecosystem







