Support Operations AI QA Specialist
Delhi / United States
Support – Support /
EE Full-Time /
Remote
About HighLevel:
HighLevel is a cloud-based, all-in-one white-label marketing and sales platform that empowers marketing agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth. With a focus on streamlining marketing efforts and providing comprehensive solutions, HighLevel helps businesses of all sizes achieve their marketing goals. We currently have 1000+ employees across 15 countries, working remotely as well as in our headquarters, which is located in Dallas, Texas. Our goal as an employer is to maintain a strong company culture, foster creativity and collaboration, and encourage a healthy work-life balance for our employees wherever they call home.
Our Website - https://www.gohighlevel.com/
YouTube Channel- https://www.youtube.com/channel/UCXFiV4qDX5ipE-DQcsm1j4g
Our Customers:
HighLevel serves a diverse customer base, including over 60K agencies & entrepreneurs and 450K million businesses globally. Our customers range from small and medium-sized businesses to enterprises, spanning various industries and sectors.
Scale at HighLevel:
We work at scale; our infrastructure handles around 3 Billion+ API hits & 2 Billion+ message events monthly and over 25M views of customer pages daily. We also handle over 80 Terabytes of data across 5 Databases.
Who You Are:
We are looking for a detail-oriented and analytical AI Quality Assurance (AIQA) Specialist to join our team. In this role, you will ensure the quality and integrity of our AI-driven solutions. With your strong background in data analysis and quality assurance, you will evaluate large datasets, extract valuable insights, and collaborate with product and development teams to uphold high standards of quality. Your problem-solving skills, attention to detail, and critical thinking abilities will be essential in maintaining and improving the performance of our AI systems.
Roles & Responsibilities
- What You’ll Be Doing:
- Data Auditing and Analysis:
- Conduct comprehensive audits of large datasets to ensure data integrity and accuracy
- Analyze data to identify patterns, trends, and anomalies that may impact AI performance
- Evaluate AI-generated responses to ensure they meet predefined quality standards
- Identify errors, biases, and areas for improvement in AI responses
- Test Case Development and Execution:
- Develop and maintain test cases to systematically evaluate the AI's performance
- Create scenarios and use cases that reflect real-world interactions and challenges
- Define and track key performance indicators (KPIs) related to AI quality and effectiveness
- Reporting and Communication:
- Prepare detailed reports summarizing findings and recommendations for improvement
- Facilitate a feedback loop with AI developers and other stakeholders to communicate findings
- Collaborate with product and development teams to ensure high-quality AI solutions
- What You’ll Bring:
- Bachelor’s degree in Computer Science, Data Science, Information Technology, or a related field
- Minimum of 3 years experience in quality assurance, data analysis, or a related field
- Strong understanding of AI and machine learning concepts
- Proficiency in using data analysis tools and software (e.g., SQL, Python, R).Experience with AI/ML model evaluation and testing
- Excellent analytical and problem-solving skills
- Strong communication and collaboration skills
- Certifications in Quality Assurance or Data Analysis are a plus (e.g., ISTQB, ASQ, Certified Data Professional).
EEO Statement:
At HighLevel, we value diversity. In fact, we understand it makes our organization stronger. We are committed to inclusive hiring/promotion practices that evaluate skill sets, abilities and qualifications without regard to any characteristic unrelated to performing the job at the highest level. Our objective is to foster an environment where really talented employees from all walks of life can be their true and whole selves, cherished and welcomed for their differences, while providing awesome service to our clients and learning from one another along the way! Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
