JobsEQ by Chmura Logo

Principal Member of Technical Staff

AT&T

Location: Tampa, Florida
Type: Full-Time, Non-Remote
Posted on: October 19, 2021
This job is no longer available from the source.
Principal-Member of Technical Staff (P-MTS) position for the Cloud Networks IP Infrastructure Advanced Technical Support (ATS) Tier 3 support team.
The successful candidate’s primary responsibility will be providing Devops team support, MOP development, and support for technology insertion (network growth and / or configuration changes), and network reliability (break-fix tier 3 support for chronic and catastrophic network incidents).  Those tier 3 level growth and break-fix responsibilities will be worked on the following Networks:
• AT&T Integrated Cloud (AIC)
• Leaf / Spine Fabric
• Access Switch
• IP Routing for tenant networking using Contrail networking (both AIC Large and AIC Medium)
• Complex and catastrophic incident recovery and Root cause analysis.
• Network Cloud (NC) Edge Networking
• Leaf / Spine fabric
• NC Pod Provider Edge (PE) router
• R-leaf GW
• NCX-Leaf)
• NC NCX-Hub PE router
• IP Routing for tenant networking incidents
• Complex and catastrophic incident recovery and Root cause analysis.
• Mobility Edge Computing (MEC)
• Multi-SIAD Switch (Juniper QFX switch)
• Azure for Operators (AfO) ATT Fabric and Routing Infrastructure
• Devops technology phase for future deployment of fabric and Mobility Workloads
• Fabric and IP router device and tenant incident troubleshooting
• .  Complex and catastrophic incident recovery and Root cause analysis.
The candidate will help lead the effort of facilitating the mitigation of complex network related break-fix issues while collaborating closely with AT&T Tier 2 support teams. Close interaction with several vendors such as Cisco, Juniper, Microsoft, and Arista will be required during the execution of above stated job responsibilities. The candidate must be proficient with advanced troubleshooting under stressful situations driving outage incident network recovery and excel at root cause analysis followed such an event. The scope of work will be extremely complex in nature requiring in depth knowledge of the layer 2 switching environment (Ethernet, VXLAN), the layer 3 IP suite of routing protocols and concepts (MPLS, LDP, OSPF, BGP, multicast, etc.), Layer 4 and higher working knowledge, statistical/analytical skills, and novel concepts/approaches to help drive catastrophic network incident and chronic issues mitigation and root cause analysis.  The candidate will make major contributions that have direct impact on the quality of service provided to customers.
The candidate will also work closely with the Labs Organizations (Tech-Arch), Technology Planning and Engineering, Technology Development (TechDev) collaborating to help define in a DEVOPs environment the requirements for new Domain 2 (Cloud based) designs and architectures. Candidate will also provide excellent support for deployments of Domain 2 virtualized architectures and maintenance network elements.  The candidate will receive Design Guidelines and other forms of design documents and will author Generic Methods of Procedures (GMOPs), validate these in a Production Support Lab (PSL), and present for Risk Assessment evaluation for the implementation of new hardware and software configurations and other security enhancements in the production network.
The candidate will demonstrate knowledge of service provider gear and software (NOS) from Cisco (IOS-XR), Juniper (JUNOS) and Arista (EOS).  Familiarity with Cloud and Cloud networking (Openstack), Linux/Unix, VMWare, ESXi, and Kubernetes (containers) is strongly desired.
As the Principal – Member of Technical Staff (P-MTS), the candidate skill set will generally be recognized in the company as a subject matter expert within an area (IP routing – cloud networks). In addition, the candidate should have worked or can work independently on projects of moderate to extreme complexity, managing technical issues.
The P-MTS will require a strong candidates who must be independent thinkers who will come up with ideas, not just be given ideas.   Candidates must be able to work collaboratively within a small research group as well as with other teams such as Product Management, Network Engineers, and Service Managers for new technology insertions and for complex break-fix chronic issues.
Required Degrees/Majors/Accreditations/Skills :
• Master-level router and IP routing protocol skills in troubleshooting, protocol analysis, IP control plane protocols, Internet, and VPN routing policy and QoS, which are all requirements for the ATS IC-6 level position. (combination of experience and technical proficiency)
• Must have a bachelor degree in an approved STEM disipline to be considered for this role.
Overall Purpose: This career step requires expert level experience. Deliver the highest level Ntwk tech support within AT&T's tech support structure requiring 24x7 on call from escalating organizations.
Key Roles and Responsibilities: Provides the technical troubleshooting and leadership skills required to recover from the most complex network problems in real time, directing the activities of technical resources from Tier-2, Labs, and the vendors to restore service. Responsible for the investigation and mgmt of all follow-up activities needed to determine root cause, attempt problem recreation in the lab, identify workarounds, delivery and certification of vendor fixes or design changes, and plan for the implementation within the network. Develop scripts to pro-actively identify known defect signatures and define the least intrusive recovery processes. Develop scripts to extract forensic data from ntwk elements and analyze to identify patterns of unexpected behavior. Responsible for the reliability of the end-to-end ntwk and the quality of the delivered service, tracking and analyzing outage patterns leading to identification of chronic issues. AT&T's SME to customers. Responsible for all equipment and software vendor mgmt relationships, insuring objectives are being met. Provides feedback during the negotiation of maintenance contracts. Responsible for the final phase of planning and preparation for the insertion of new technology and changes into the ntwk. Review and signoff of Lab designs. Design equipment and software certification testing. Development and testing of the detailed methods and procedures for introduction of new technology and the handoff to Tier-2 Network Operations and Project Mgmt org for field implementation. Develop troubleshooting guides and deliver knowledge transfer on new designs and technology. Gather and analyze relevant ntwk element field data to validate the expected improvements and features of the field changes. Manage the risk of new technology introduction. Job Contribution: Expert level technical professional. Advisor on technical knowledge and ATT technologies.
Education: Bachelor Degree in Engineering, Math or Science preferred or related experience.
Experience: Typically requires 8-10 years experience. Technical Career Pathway (TCP) role.
Supervisory: No.
Qualifications - Internal
Principal Functional Skills / Competencies associated with this Title:
• Broadcast Engineering/Video Technologies
• Business Orientation
• CLOUD NETWORKING
• Configuration Management
• Core Business Tools
• Data Analysis Tools
• E911 Engineering
• EMS (Element Management System)
• Fault Management/Network Incident Management
• Hypervisor
• IP Routing and Protocols
• Microwave Technologies
• Mobile Operating Systems and Platforms
• Network Architecture
• Network Modeling and Analysis
• Network Performance Management
• Operating Systems & Environments (Network)
• Performance Measurement and Tuning
• Process Management
• Project Management
• Quality Assurance and Testing
• Quality Management
• RAN Engineering
• Reliability Engineering
• Risk Management
• Router configuration expertise
• Signaling Technologies
• Sniffer
• Software Engineering
• Software Release Management
• Storage Area Networks
• SWITCH configuration expertise
• Technical Troubleshooting (routing and switching networks)
• Technical Writing/Documentation
• Telecom Regulatory Environment
• Telecommunications
• Testing
• Transport Data Services
• Virtual Private Networks (VPNs)
• Virtualization Tools and Technologies
• VoIP Technologies
• White Box knowledge and experience.
Required Qualifications -
• Entry into this title will require Technical Title Plan (TTP) Board Approval.
• Candidate shall have a PhD in an approved field from an accredited university and a minimum of 4 years of relevant experience, or a Master's degree in an approved field from an accredited university and a minimum of 6 years of relevant experience, or a  Bachelor's degree in an approved field from an accredited university and a minimum of  8 years of relevant experience
• Five or more years experience with networks, network protocols, and IP networks and at least seven years of experience with web development using PHP, Perl, Action script and Java programming through all phases of the software development lifecycle
• A strong understanding of security technology in the areas of VPN, firewalls, proxy, and IDS/IPS as well as experience in Linux, Solaris and Windows
• Candidate must have a strong communication skills both verbally and written as well as strong problem solving skills
• Ability to balance and prioritize work and work independently and as part of a team
• Previous experience as a system tester and experience in a lab test environment
Desired Qualifications -
• CISSP, CCNA certification, or GIAC Certified Intrusion Analyst (GCIA)
• Experience with any/all of following software tools: PHP, Perl, Action Script, Java, JavaScript,  Linux, XML, CVS/SVN, Linux Shell Scripts, and Oracle
• Check Point VSX experience
• Crossbeam, Fortinet and Cisco configuration experience
• TS/SCI Government Clearance
• Network and Hardware support experience as well as database design
• ISP Services Planning and Architecture
• ICDS Service Planning and Architecture
• ISP level data networks experience
• Hands-on experience with performance and security test gear
• Understanding of Internet security threats and mitigation techniques
AT&T will consider for employment qualified applicants in a manner consistent with the requirements of federal, state and local laws
Required Qualifications -
• Entry into this title will require Technical Title Plan (TTP) Board Approval.
• Candidate shall have a PhD in an approved field from an accredited university and a minimum of 4 years of relevant experience, or a Master's degree in an approved field from an accredited university and a minimum of 6 years of relevant experience, or a  Bachelor's degree in an approved field from an accredited university and a minimum of  8 years of relevant experience
• Five or more years experience with networks, network protocols, and IP networks and at least seven years of experience with web development using PHP, Perl, Action script and Java programming through all phases of the software development lifecycle
• A strong understanding of security technology in the areas of VPN, firewalls, proxy, and IDS/IPS as well as experience in Linux, Solaris and Windows
• Candidate must have a strong communication skills both verbally and written as well as strong problem solving skills
• Ability to balance and prioritize work and work independently and as part of a team
• Previous experience as a system tester and experience in a lab test environment
Desired Qualifications -
• CISSP, CCNA certification, or GIAC Certified Intrusion Analyst (GCIA)
• Experience with any/all of following software tools: PHP, Perl, Action Script, Java, JavaScript,  Linux, XML, CVS/SVN, Linux Shell Scripts, and Oracle
• Check Point VSX experience
• Crossbeam, Fortinet and Cisco configuration experience
• TS/SCI Government Clearance
• Network and Hardware support experience as well as database design
• ISP Services Planning and Architecture
• ICDS Service Planning and Architecture
• ISP level data networks experience
• Hands-on experience with performance and security test gear
• Understanding of Internet security threats and mitigation techniques
AT&T will consider for employment qualified applicants in a manner consistent with the requirements of federal, state and local laws
Employment Type: Full-time