Data Engineer, Sr. - Remote

## About the Role xScion is seeking a Senior Data Engineer to design, develop, and operationalize large-scale enterprise data solutions across cloud and big data environments. This remote, US-based position focuses on AWS data platforms, cloud migration, data pipelines, application modernization, and production data solutions. The role will work across architecture, design, development, testing, and production support while partnering with technical and business teams to translate requirements into scalable solutions. The Senior Data Engineer will also contribute to the migration of on-premise Hadoop environments to AWS-native technologies and support existing data platforms during the transition. ## Key Responsibilities Design, develop, and operationalize large-scale enterprise data solutions using AWS services. Build and maintain solutions using AWS S3, Glue, Athena, Lambda, Redshift, EMR, Spark, and DynamoDB. Analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop platforms to AWS-native data technologies. Design, develop, and deploy end-to-end data pipelines from ingestion through consumption within big data architectures. Develop data solutions using Java, Python, or Scala. Participate in architecture, technical design, and product development discussions. Analyze business requirements and translate them into technical data solutions. Take ownership of complete user stories through analysis, design, development, and testing according to project timelines. Develop and maintain scripts to automate batch processing and jobs. Support and maintain existing applications and data solutions. Troubleshoot and resolve technical issues in production environments. Maintain Hadoop-based data solutions during cloud migration, including HDFS, Oozie, Impala, and Hive. Implement enhancements to existing Hadoop environments as needed during migration. Follow technical best practices, internal processes, and information security controls. Collaborate effectively with engineering and project teams to deliver high-quality solutions independently. ## Required Qualifications Bachelor's degree in Computer Science, Information Technology, or another relevant field. 7+ years of software development experience related to data engineering. Must be a US Citizen or a Green Card holder for more than 3 years with the intent to become a US Citizen. Hands-on experience with Java, Python, or Scala. Strong ability to understand and write complex SQL queries. Proficiency with AWS services including: Amazon S3 AWS Glue Amazon Athena AWS Lambda Amazon Redshift Amazon EC2 Amazon EMR Apache Spark Amazon DynamoDB Experience using Java, Python, Scala, or PySpark in AWS data engineering environments. Experience deploying software solutions to cloud platforms through CI/CD in a DevOps environment. Understanding of application and data security concepts. Exposure to AWS security and monitoring services including IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, and KMS. Hands-on experience with Hadoop technologies such as HDFS, Oozie, Impala, and Hive. Experience with Infrastructure as Code using Ansible, Terraform, or CloudFormation. Experience working with Hadoop-based big data architectures and solutions. Experience working in an Agile development environment. Familiarity with Agile tools such as Jira or Rally. Proficiency with UNIX commands and shell scripting. Strong communication, collaboration, and teamwork skills. Ability to work independently while delivering high-quality technical solutions. ## Preferred Qualifications Experience working with relational database management systems (RDBMS). Experience with data warehouses. Experience with machine learning technologies. Experience with data visualization tools. ## Technical Environment The role involves working across modern cloud and big data technologies, including: Cloud: AWS AWS Data Services: S3, Glue, Athena, Redshift, EMR, Lambda, DynamoDB Big Data: Hadoop, HDFS, Oozie, Impala, Hive, Spark Programming: Java, Python, Scala, PySpark Databases & Querying: SQL, RDBMS, data warehouses DevOps: CI/CD Infrastructure as Code: Ansible, Terraform, CloudFormation Security & Monitoring: IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, KMS Scripting: UNIX, shell scripting Agile Tools: Jira, Rally ## Work Environment Location: Remote, United States The position is associated with Los Angeles, San Francisco, Salt Lake City, Portland, and Seattle. The role supports cloud transformation, enterprise data engineering, application modernization, and big data initiatives. Collaboration takes place across architecture, engineering, product, and business teams. ## Compensation & Benefits xScion provides a comprehensive benefits package that includes: Medical insurance Dental insurance 401(k) matching Flexible spending options Up to 27 days off per year, including a birthday Remote work opportunities Parental leave Wellness benefits Additional programs designed to support work-life balance and flexibility ## Professional Development xScion supports continuous professional development through: Communities of Practice Technology partnerships Technology sandbox environments Certification support Training opportunities Opportunities to contribute to impactful client and team initiatives ## About xScion xScion helps organizations in highly regulated industries accelerate digital transformation by turning complex changes into smaller, actionable initiatives that create lasting value. The company provides solutions across Business Agility, Cloud Transformation, and Organizational Change Management. xScion works with organizations in Financial Services, Public Sector, Nonprofits, and Healthcare and has more than 20 years of experience supporting Regulatory Technology (RegTech), compliance, technology transformation, and organizational change initiatives. The company is a certified Woman-Owned Small Business. ## Equal Employment Opportunity xScion provides equal employment opportunities to qualified applicants and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status, or other protected characteristics under applicable law. Applicants are also added to xScion's talent community when applying and may opt out at any time.