Principal Engineer - Automation Platform Developer

Job Description
Insight Global is seeking a Principal Engineer to support a nationwide network serving millions of customers by implementing approved architectures and designs. This Principal Engineer will lead the architecture, engineering, and strategic evolution of a Hadoop-based data platform, driving scalability, reliability, security, and operational excellence. Success in this role requires strong Hadoop expertise, architectural leadership, collaboration across teams, and mentorship of engineers.

Job Responsibilities:
- Owns the architecture, design, and lifecycle management of enterprise Hadoop clusters and supporting data platform services.
- Leads administration of Hadoop ecosystem components such as HDFS, YARN, Hive, HBase, Spark, Kafka, Oozie, ZooKeeper, Impala, and related tooling.
- Defines platform standards for availability, performance, capacity planning, disaster recovery, backup, monitoring, and security.
- Drives infrastructure optimization a...