Data Engineer - Security & Intelligence
EnvitiaFull Time
Job description
About the role
Envitia is seeking a skilled Data Engineer to join our Security & Intelligence team. This position is pivotal in enhancing our data processing capabilities, ensuring that our security solutions are both effective and efficient. As a Data Engineer, you will work closely with cross-functional teams to design and implement data pipelines that support our intelligence operations. Your expertise will contribute to the development of innovative solutions that address complex security challenges, making a significant impact on our mission.
Key facts
What you'll do
- Design and develop robust data pipelines that facilitate the collection, processing, and storage of large volumes of security-related data.
- Collaborate with data scientists and analysts to understand their data needs and translate them into technical specifications for data solutions.
- Implement data integration processes from various sources, ensuring data quality and consistency across platforms.
- Optimize existing data workflows to improve performance and reduce latency in data retrieval and processing.
- Monitor and troubleshoot data pipeline performance, identifying and resolving issues proactively to ensure uninterrupted data flow.
- Maintain documentation for data architecture, processes, and workflows to support knowledge sharing and compliance.
- Participate in the evaluation and selection of new data technologies and tools that align with our strategic goals.
- Work closely with security teams to ensure that data handling practices comply with industry standards and regulations, safeguarding sensitive information.
- Engage in code reviews and provide constructive feedback to peers, fostering a culture of continuous improvement within the engineering team.
- Stay updated on industry trends and emerging technologies in data engineering and security, applying insights to enhance our systems.
- Contribute to the development of best practices for data governance and data management within the organization.
- Assist in training junior team members and sharing knowledge to build a high-performing data engineering team.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- A minimum of 3 years of experience in data engineering or a similar role, with a focus on security applications.
- Proficiency in programming languages such as Python, Java, or Scala, with a solid understanding of data structures and algorithms.
- Experience with data warehousing solutions and ETL processes, including tools like Apache Airflow, Talend, or similar.
- Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and their data services, such as Redshift, BigQuery, or Azure Data Lake.
- Strong understanding of database technologies, including SQL and NoSQL databases, and experience with data modeling.
- Knowledge of data security principles and practices, particularly in relation to sensitive and classified information.
- Excellent problem-solving skills and the ability to work independently as well as collaboratively in a team environment.
- Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
- A proactive attitude towards learning and adapting to new technologies and methodologies.
Nice to have
- Experience with big data technologies such as Hadoop, Spark, or Kafka.
- Familiarity with machine learning frameworks and their integration with data pipelines.
- Knowledge of data visualization tools like Tableau or Power BI to support data-driven decision-making.
- Previous experience working in a security-focused organization or project.
- Certifications in data engineering or cloud technologies (e.g., AWS Certified Data Analytics, Google Professional Data Engineer).
Skills & tools
- Programming Languages: Python, Java, Scala
- Data Technologies: SQL, NoSQL, Apache Airflow, Talend
- Cloud Platforms: AWS, Azure, Google Cloud
- Big Data: Hadoop, Spark, Kafka
- Data Visualization: Tableau, Power BI
Practical notes
- The specific location for this role is currently unknown, but candidates should be prepared for potential remote work options or relocation.
- The salary is competitive and will be determined based on the candidate's experience and qualifications.
- Envitia is open to sponsoring visas for qualified candidates, making this an excellent opportunity for international applicants.
- Interested candidates can apply through the following link: [Envitia Careers](https://envitia.bamboohr.com/careers/159).
META
Company: Envitia
Title: Data Engineer
Security & Intelligence
Listed
location: Unknown
Job type: Full-time