AI Search Analyst (Remote, Full-Time) [HR224] (PK)
In short
As an AI Search Analyst, you will evaluate AI-powered search performance for a UK retailer, providing insights for business decisions. You will collaborate with various teams to enhance AI search measurement and reporting.
What they ask for
- 3+ years in digital or ecommerce analytics
- Strong Python and SQL skills
- Experience with GA4, BigQuery and Looker Studio
- Solid understanding of statistics
- Ability to analyse complex datasets
Summarised by AI from the full description below.
As an AI Search Analyst, you will track and evaluate how a leading UK online electrical retailer performs across AI-powered search platforms, turning insights into meaningful business decisions. As more customers turn to AI assistants for product recommendations, understanding AI visibility and its commercial impact is becoming increasingly important.
You will lead AI search measurement as part of an embedded AEO/GEO programme, collaborating closely with the AEO/GEO Lead, commercial analytics, paid search, trading and senior marketing stakeholders.
You will develop robust measurement frameworks, strengthen attribution and deliver actionable insights that enable senior leaders to assess performance, identify opportunities and understand how AI search contributes to revenue.
Responsibilities
- Lead end-to-end AI search measurement, competitive benchmarking and performance reporting.
- Conduct weekly AI visibility benchmarks across ChatGPT, Gemini, Perplexity, Copilot and Google AI experiences, covering large appliances, TVs and audio, mobiles, small appliances and smart home categories.
- Automate prompt testing, scoring and data collection using LLM APIs and AI visibility platforms.
- Build and maintain clean, structured and easily accessible datasets.
- Assess AI-generated responses for citations, product recommendations, ranking positions, sentiment and factual accuracy against competitors.
- Apply statistical techniques to evaluate data variance, sample sizes, confidence intervals and changes in AI models.
- Track AI-driven traffic, conversions and revenue through GA4 and BigQuery.
- Measure the effectiveness of AEO/GEO initiatives and structured data improvements using controlled comparisons where possible.
- Analyse the relationship between AI search, paid search and organic search performance.
- Develop and maintain Looker Studio dashboards for marketing and retail stakeholders.
- Deliver weekly performance updates, highlighting key findings and actionable recommendations.
- Prepare targeted performance reports for Black Friday and major product launches.
- Identify and investigate inaccuracies in AI-generated information relating to pricing, delivery, price matching and customer reviews.
- Work closely with analytics, paid search, trading and marketing teams to turn insights into business actions.
Requirements
- 3+ years of experience in digital, marketing or ecommerce analytics.
- Strong Python and SQL skills, including API scripting and automated data collection.
- Experience with GA4, BigQuery and Looker Studio, or an equivalent analytics stack.
- Confident Excel skills.
- Solid understanding of statistics, including sampling, variance, significance and limitations of observational data.
- Experience with, or a clear interest in, LLM APIs and evaluating model outputs.
- Understanding of SEO or paid search data and its relationship with revenue.
- Ability to independently build and maintain data pipelines.
- Ability to analyse complex, changing datasets and communicate clear, evidence-based insights to senior stakeholders.
- Strong analytical rigour and the ability to explain findings to non-technical audiences.
- A sceptical, evidence-led mindset with the confidence to challenge weak attribution assumptions.
Nice to Have
- Hands-on experience with AI visibility platforms such as Profound, Peec AI, Ahrefs Brand Radar or Semrush's AI toolkit.
- Experience with LLM evaluation methods, including automated scoring of model responses.
- Experience working in retail businesses with significant seasonal demand peaks.
- Background in consumer electricals or high-consideration retail.
- Experience with experiment design or causal inference in marketing.
Similar jobs
Bitmovin
Senior Product Marketing Manager
Zapier
Finance Manager, Marketing
Zapier
Sr. Product Marketing Manager, Enterprise
Interested in this role?
You'll apply directly on the company's site.
Apply on company site- Open to people in Pakistan
- Posted on November 19, 2026 (about 19 hours ago)
- Apply link checked 15 minutes ago
- Open until December 20, 2026
Know someone for this role?
Share it with a friend or your network.
Build the skills for this job
This role asks for skills you can learn with SheCodes: