Senior Manager, Test and Learn

Company: PEAK SEASON INC
Location: Broomfield
Posted on: April 2, 2021

Job Description:

Reach Your Peak at Vail Resorts. As a community of adventurers and discoverers, Vail Resorts delivers an experience of a lifetime to our guests and our employees. Our team is made whole by the brave, passionate individuals who ambitiously push boundaries and challenge the status quo. Whether you're looking for seasonal work or the career of a lifetime, join us today to reach your peak. Job Summary The primary purpose of the Sr. Mgr, Test and Learn position is to lead a team providing recommendations & analysis for all levels of marketing testing at Vail Resorts. This includes channel personalization improvements, monitoring performance of live A-B testing across major marketing initiatives and audiences, identifying reporting opportunities for test performance reads, and partner with other Analytics and Marketing teams to turn test analysis into enterprise insights. You will partner with Digital Experience, Media, Relationship Marketing, Analytics, and IT teams to define test hypotheses, identify success/failure criteria, and select representative audience samples. You will also coordinate with other internal analytics and channel teams to identify opportunities for improved efficiency and to ensure ongoing reporting is created in the most standardized manner possible. Your involvement in Marketing includes: being the key leader between Analytics / Channel Marketing for identifying test prioritization, ensuring team analysis and reporting processes are conducted correctly and in a timely manner, explaining and analyzing test results, providing enterprise recommendations, troubleshooting tests as needed, and producing strategic presentations and ad-hoc analysis as required by the business leaders. You will be the key leader whose team is responsible for helping senior leaders understand: A-B & multivariate testing effectiveness, confidence thresholds, and using Test & Learn software to forecast roll-out effectiveness in hitting business goals. Job Responsibilities

• [Team Leadership and Development] Partner with internal teams to help lead enterprise testing across all of Marketing, Sales and Communications. Provide direct reports with guidance and prioritization of work efforts to manage multiple complex single and multi-channel tests across many different business units simultaneously.
• [Testing Culture & Knowledge Base] Guide Vail Resorts internal teams through testing best practices to drive impact to business results, provide leadership on testing methodology & specific assumptions used in analysis, and to enforce integrity of testing process and use of best practices across the enterprise. Leverage historical learnings to make recommendations on strategy to marketing leadership & lead culture changes to enable an agile Test & Learn environment.
• [Strategy & Organization] Partner with Marketing & Channel teams to understand go-to-marketing strategies, business objectives, and key questions to maintain commitments to hitting overarching testing roadmap. Leverage prior test performance and new insights to provide testing recommendations (defining the hypothesis, reporting KPIs, audience segments, traffic splits, etc.).
• [Testing Design Support] Understand Test & Learn tooling and setup process, define success/failure criteria across key KPI's, check & mitigate against sample bias, advise & measure against confidence levels, and propose audience splits.
• [Interpretation & Insights] Partner with Analytics, Channel, and IT teams to provide ongoing test reads, reporting, and actionable insights. Understand and be able to interpret lift impacts and confidence levels using business acumen. Advise high-impact audiences for roll-out of winning experiences. Forecast and measure testing lift against baseline business results.
• [Standardization & Efficiency] Partner with Test & Learn teammates to align processes, facilitate trainings, and document best practices that ensure efficient and consistent analysis across the team. Standardize methodology for addressing common questions and ensure that consistent approaches be utilized across the enterprise. Proactively develop new analytic approaches and partner with other analytical groups to develop tools that support marketing tactics at every level.
• [Ad-hoc] Support complex ad-hoc pre, during, and post analysis of tests as required by senior leadership and partner teams.
• [IT Troubleshooting] Leverage knowledge of test setup, site & omni-channel campaign implementation, and key business KPIs to partner with IT teams to quickly troubleshoot issues as they arise during testing periods. Job Requirements Required:
  • Bachelor's degree in related field (Business, Economics, Statistics, Computer Science, Data Science, or Mathematics)
  • 4-7 years prior marketing analytics, A-B testing, statistics, digital analytics, or other related experience
  • 2-3 years of experience leading a team of analysts
  • Demonstrated strength in written and verbal communication, adjusting message to audiences specifically C-Suite / Vice President level
  • Excellent interpersonal and relationship management skills, with the ability to communicate effectively at all levels of the organization
  • Must be able handle multiple projects simultaneously and coordinate across multiple functions within an organization
  • Experience evaluating website or marketing channel performance, including analysis of A-B experiments and evaluation of results against randomized control groups
  • Statistics background including but not limited to A-B Testing, Multivariate Testing, Regression Analysis, and Hold-out Experiments
  • Demonstrated success understanding very large data sets, and developing team processes for streamlined analysis, and creating insights that succinctly summarize complex concepts
  • Experience with 1 or more analytics tools/software specific to testing analysis (Adobe Analytics / Adobe Target / Optimizely / Google Analytics / APT / other CRO platforms)
  • High level of comfort with Testing and interactions with Marketing Technology Preferred:
    • Hospitality or travel industry experience helpful The budgeted range starts at $90,000 - $113,000 + annual bonus. Actual pay will be adjusted based on experience. The perks include a free ski pass, and a set of benefits including...
      • Medical, Dental, Vision insurance, and a 401(k) retirement plan
      • Hourly employees are generally eligible for accrued Paid Time Off (PTO), Extra Time Off (ETO) and Sick Time. Salaried employees are generally eligible for Flexible Time Off (FTO)
      • Paid Parental Leave for eligible mothers and fathers
      • Life, AD&D, and disability insurance We offer a variety of career opportunities at our world-class resorts and corporate headquarters near Boulder, Colorado in fields like Finance & Accounting, Human Resources, Information Technology, Legal, Public Affairs & Sustainability, Marketing, Sales & Communications and more. Our corporate team shares both a passion for the outdoors and a drive to re-imagine the mountain resort experience around the world. Learn more at www.vailresortscareers.com Vail Resorts is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, protected veteran status or any other status protected by applicable law. Address Broomfield, CO 80020
        United States

Keywords: PEAK SEASON INC, Broomfield , Senior Manager, Test and Learn, Executive , Broomfield, Colorado