[Remote] Data Engineer, California College Guidance Initiative

Note: The job is a remote job and is open to candidates in USA. The Foundation for California Community Colleges is hiring a Data Engineer for the California College Guidance Initiative (CCGI), an autonomous initiative housed at the Foundation. The role develops and maintains CCGI’s cloud data infrastructure, data pipelines, and analytics tools, supporting the initiative’s education and student-guidance work.

Responsibilities

• Lead the development, maintenance, and optimization of batch and streaming ETL/ELT processes, including the development, refinement, and containerization of data loading and processing using event driven architecture and workflow orchestration
• Develop, containerize, test and maintain workflows within integrated development environments (IDEs) using AWS cloud services, Snowflake data warehouses, Python and SQL scripts, dbt, and shell scripts
• Review, redesign, and expand data models supporting data warehousing and self-service business intelligence architecture to create fully automated data pipeline(s) from staged or streamed data to organization of data warehouse objects and producing access via reporting, alerts or API access
• Design and implement data pipeline automation requiring Python scripting and SQL statements, integrating with systems such as Salesforce, Slack and AWS services using serverless, cloud servers and containerized systems
• Participate in meetings, research processes, requirement collection, data analysis, and collaborate with the key project collaborators.stakeholders of your projects
• Develop and maintain expert knowledge of CaliforniaColleges.edu data, systems, and business processes
• Continuously improve data pipelines and architecture by staying updated on industry trends and best practices
• Other duties as assigned by your supervisor

Skills

• Relevant BA/BS in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field
• Minimum of three (3) years of experience as a Data Engineer or a related role
• Ability to build processes supporting data transformation, data structures, metadata, dependency, and workload management
• Advanced proficiency with cloud data warehousing analytical tools such as Snowflake, Redshift,  Spark, Kafka, etc
• Expert SQL knowledge (SQL Server, PostgreSQL, MySQL, etc.) and understanding of relational databases, query authoring and optimization, as well as working familiarity with a variety of databases
• Advanced proficiency using ETL tools like Jupyter Notebooks, dbt, Talend, etc
• Advanced proficiency with scripting languages like Python, Scala, R,  etc
• Advanced proficiency building and optimizing data pipelines and data sets
• A successful history of manipulating, processing and extracting value from large structured and unstructured datasets
• Demonstrated ability to consistently develop strong technical documentation
• Strong data analysis and decision-making skills with the ability to take abstract brainstorming and generate concrete proposals for action
• Ability to advance projects without detailed supervision, prioritize tasks, and effectively manage multiple projects simultaneously
• Experience supporting and collaborating with cross-functional teams in a dynamic environment
• Ability to write with attention to accuracy, audience, and concision within task tickets in project management tools like Jira
• Excellent verbal communication skills and the ability to communicate complex information simply with both technical and non-technical audiences
• Advanced certifications such as SnowPro Core, AWS Cloud Practitioner Certification,  or AWS Certification, Solutions Architect - Associate are a plus
• Experience working with K-12 data and/or education data is encouraged
• A commitment to increasing educational access and equity

Benefits

• Paid holidays, sick and vacation leave
• Medical, dental, and vision insurance
• Employee Assistance Program
• Defined benefit retirement plan (CalPERS)
• 403(b) and 457(b) retirement plans
• $50,000 Basic Life and Accidental Death and Dismemberment insurance coverage for eligible employees
• Flexible Spending Accounts
• Tuition Reimbursement
• Voluntary Life Insurance
• Pet insurance
• Remote work from home offices within California, with occasional travel and occasional internal in-person meetings

Company Overview