[Remote] Staff AI Engineer - Grafana AI/ML | USA | Remote

Note: The job is a remote job and is open to candidates in USA. Grafana Labs builds observability tools that help users understand and improve their systems. The Staff AI Engineer develops and ships AI-powered features that use observability data to help users detect, triage, and resolve incidents, while expanding AI agent capabilities across the observability stack.

Responsibilities

• Build and deliver AI solutions: Take ownership of developing high-performance AI features to help users detect, triage, and resolve incidents using observability data and tools
• Rapid experimentation and iteration: Implement a highly iterative process where you quickly prototype, test, and validate with real users, including shipping and evolving LLM- or agent-powered workflows for incident lifecycle management and automated analysis tasks
• Collaborate cross-functionally: Work with data analysts, product managers, and designers to shape AI-driven product features, including integration of agentic components with internal tools, alerting systems, runbooks, and developer workflows
• Utilize AI tools effectively: Use AI and automation tools to enhance both product functionality and your own development workflows
• Effective communication: You’ll be working in a highly dynamic and collaborative environment, so we need someone who can communicate effectively and contribute across teams
• Ownership and impact: Take full ownership of the AI solutions you develop, ensuring they are not only innovative but also scalable, maintainable, and aligned with real user workflows

Skills

• We're looking for an AI Software Engineer with a strong software engineering background, a quick iteration mindset, and a passion for experimentation
• Someone who can communicate effectively and contribute across teams
• Strong engineering skills: Solid experience building production software systems (backend and / or full stack)
• You're a self-starter, capable of tackling complex engineering problems with minimal supervision
• AI experience with a practical mindset: You're familiar with AI technologies and frameworks, and you focus on delivering high-quality solutions that work in the real world, not just in theory
• Quick iteration and experimentation: You're comfortable releasing prototypes, collecting feedback, and iterating with a pragmatic mindset
• Proven initiative: You take ownership and drive projects forward, pushing boundaries to find the most impactful solutions
• You can deal with ambiguity and are able to define scope where things are loosely defined
• Collaborative attitude: You communicate effectively with peers, product managers, and designers
• You're open to feedback, and you bring a solutions-oriented mindset to the table
• Experience with LLMs, prompt engineering, and building applications powered by GenAI
• Proven track record of delivering software that made it into production and is actively used by users
• Exposure to working in cloud-native environments (e.g., AWS, GCP, Azure)
• Experience using observability tools to understand and troubleshoot system behavior
• Experience building or working with agent frameworks or multi‑agent workflows
• Experience with infrastructure / devops related tooling: Kubernetes, Docker, Terraform or similar for deployments
• Familiarity with model fine-tuning techniques
• Experience building observability tooling

Benefits

• Company-funded usage budget for AI coding assistants
• Access to the latest frontier models from OpenAI, Anthropic, and Google
• Equity, including Restricted Stock Units (RSUs) for all team members
• Bonus (if applicable)
• 100% remote work in a remote-only company
• Defined opportunities to grow and develop your career
• In-person onboarding with fellow new Grafanistas
• 30 days of annual leave per annum, including 3 days reserved for Grafana Shutdown Days (subject to local legislation)

Company Overview

Company H1B Sponsorship