We are seeking a highly skilled DevOps Engineer specializing in Data Management to support our cloud and on-premise infrastructure. The ideal candidate will play a key role in designing, implementing, and maintaining scalable and reliable environments for our own innovative software solutions in the water and energy sector. The role requires expertise in CI/CD, automation, security, and scripting, with a focus on data integrity, monitoring, and troubleshooting.
Key Responsibilities:
1) Data Management & Infrastructure:
- Design, deploy, and maintain scalable and reliable infrastructure on Microsoft Azure and on-premise environments
- Monitor and optimize system performance, security, and cost
- Troubleshoot connectivity issues between data sources and central data repositories
- Identify and resolve data gaps, ensuring accurate data synchronization
- Configure and validate time series calculations and ensure correctness of computed values
- Investigate and resolve update-related issues affecting data pipelines
2) Automation & Scripting:
- Automate manual processes to improve operational efficiency
- Develop and maintain PowerShell and Python scripts for infrastructure management
- Implement automated file transfers and imports using Python (e.g., Pandas, SQL)
3) Security & Compliance:
- Implement and enforce security best practices in cloud and on-prem environments
- Collaborate with security teams to ensure compliance with industry regulations
- Manage user access and authentication via Active Directory and certificate management
4) Monitoring & Troubleshooting:
- Set up and configure monitoring tools to ensure high availability and performance of Azure services
- Identify and resolve infrastructure and application issues efficiently
- Ensure network reliability with knowledge of firewalls, ports, routing, and basic networking principles
5) Version Control & Containerization:
- Utilize Bitbucket for version control and collaboration
- Deploy and manage containerized applications using Docker and Docker-Compose