Hardware Systems Engineer AI Hardware
San Francisco, CA - USA
Job Summary
At Cloudflare we are on a mission to help build a better Internet. Today the company runs one of the worlds largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware installing software or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network which gets smarter with every request. As a result they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazines Top Company Cultures list and ranked among the Worlds Most Innovative Companies by Fast Company.
At Cloudflare were not looking for people who wait for a polished roadmap; were looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a normalized problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration leveraging AI to ship faster today to make it better tomorrow while ensuring that every improvement no matter how small is shared across the team to lift everyone up. If youre the type of person who values curiosity over bureaucracy and that AI is a partner in solving tough problems to keep the Internet moving forward youll fit right in.
Available Locations: Austin Texas Lisbon Portugal
About The Department
Cloudflares Infrastructure group is responsible for building our global network. Our Hardware Engineering team helps research develop test and deploy new equipment enabling 20% of the worlds internet traffic to be served smoothly. Deployed across 330 cities in 120 countries the hardware we select helps improve the security reliability and performance of the Internet.
About The Role
We need to make thoughtful infrastructure choices affecting a significant portion of the Internet. Hardware we work with includes GPUs servers and components as well as PDUs and network hardware. As a Hardware Systems Engineer you will work with colleagues on the Engineering teams Product and Performance teams and Hardware Sourcing teams to design qualify and maintain Cloudflares worldwide fleet of GPU servers.
What Youll Do
- Contribute to the technical requirements and end-to-end delivery of AI infrastructure compute networking storage power and cooling not just the accelerator
- Evaluate select and qualify AI hardware platforms (GPUs custom ASICs SmartNICs storage) based on real workload requirements and first-principles analysis
- Design and validate rack-scale GPU systems: multi-node topologies high-speed interconnects (NVLink InfiniBand RoCE) power distribution and thermal management
- Run hands-on qualification: benchmarking stress testing failure mode analysis and vendor RCA you close the loop yourself
- Assess and qualify ODM/OEM server platforms; engage directly with vendors and work through the full technical qualification cycle
- Translate AI product and workload requirements into precise infrastructure specifications
- Identify gaps in the existing infrastructure stack and drive solutions across hardware firmware software and operations
- Stay ahead of the AI hardware landscape new silicon new interconnects new form factors and bring informed opinionated recommendations
- Build tooling and automation to support qualification workflows performance analysis and ongoing operational visibility
- Communicate your results and updates through blog posts and internal talks
Examples Of Desirable Skills Knowledge And Experience
- Bachelors Masters or PhD degree in Computer Engineering Electrical Engineering or Computer Science
- Experience in AI infrastructure systems engineering or hardware platform engineering
- First-principles understanding of AI accelerator architecture: compute pipelines memory hierarchy (HBM GDDR) interconnect topology and/or how workload characteristics map to hardware capabilities
- Hands-on experience qualifying AI server platforms youve run NCCL tests profiled collective operations debugged NVLink errors and chased down PCIe lane misconfigurations
- Understand rack-scale systems: high-density power (kW/rack busbar PDU) liquid cooling (rear-door direct liquid immersion) high-speed networking infrastructure and/or physical layer constraints
- Experience with AI/ML frameworks (vllm sglang) at the systems level you understand what they demand from the hardware and where bottlenecks actually live
- Familiarity with AI server form factors: HGX OAC OAM UBB open rack standards and the tradeoffs between them
- Scripting and automation skills (Python Bash Go and Linux sysadmin); you build tooling to support your own work and the teams
- Strong written communication you can write a rigorous technical specification and a crisp vendor requirements document
- Knowledge of performance benchmarking ; Previous experience in testing measuring and/or simulating hardware performance and an understanding of no-stone-left-unturned experimentation
- Knowledge of Redfish IPMI and server remote management protocols and experience with firmware updates
- Harness AI tools and automation to fundamentally accelerate the qualification lifecycle driving exponential efficiency gains and quality standards.
- Possess the organizational skills and interest to manage cross-functional technical projects ensuring architectural designs seamlessly align with delivery schedules.
- Thrive as a deeply self-motivated engineer in ambiguous environments demonstrating a strong bias for action and the ability to drive initiatives forward without close supervision.
Bonus Points
- Experience with major AI server ODMs/OEMs and their qualification and customization processes
- Exposure to hyperscaler or cloud infrastructure design understanding how GPU capacity is provisioned allocated and operated at scale
- Experience with RDMA networking RoCEv2 congestion control or InfiniBand fabric management
- Understanding of AI workload patterns: LLM training vs. inference model/tensor/pipeline parallelism and their memory and bandwidth implications
- Familiarity with open compute hardware programs or OCP specifications
- Experience of performance optimization based on hardware / software codesign
- Experience of kernel development compiler optimization or driver development.
- Experience of observability and monitoring tools such as Prometheus and Grafana as well as the ability to observe trends over time
- Experience with software development tools and processes such as Git TeamCity and Jira
- Experience in a hyperscale cloud infrastructure role also valuable
- Knowledge of debugging server hardware faults and the ability to engage with our sourcing team and vendors to improve quality
Who You Are
- A self-starter who identifies what needs to be done and executes without waiting to be asked
- Genuinely curious you read architecture whitepapers follow chip announcements and have opinions on why one memory subsystem beats another
- Equally comfortable racking servers in a lab and writing a detailed technical requirements document
- Able to make a defensible technical decision with incomplete information and communicate the reasoning clearly
Compensation
Compensation may be adjusted depending on work location.
- For Lisbon based hires: Estimated annual salary of
Equity
This role is eligible to participate in Cloudflares equity plan.
Benefits
Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses support caregiving build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States and benefits may vary for employees based outside the U.S.
Health & Welfare Benefits
- Medical/Rx Insurance
- Dental Insurance
- Vision Insurance
- Flexible Spending Accounts
- Commuter Spending Accounts
- Fertility & Family Forming Benefits
- On-demand mental health support and Employee Assistance Program
- Global Travel Medical Insurance
Financial Benefits
- Short and Long Term Disability Insurance
- Life & Accident Insurance
- 401(k) Retirement Savings Plan
- Employee Stock Participation Plan
Time Off
- Flexible paid time off covering vacation and sick leave
- Leave programs including parental pregnancy health medical and bereavement leave
Were not just a highly ambitious large-scale technology company. Were a highly ambitious large-scale technology company with a soul. Fundamental to our mission to help build a better Internet is protecting the free and open Internet.
Project Galileo: Since 2014 weve equipped more than 2400 journalism and civil society organizations in 111 countries with powerful tools to defend themselves against attacks that would otherwise censor their work technology already used by Cloudflares enterprise customers--at no cost.
Athenian Project: In 2017 we created the Athenian Project to ensure that state and local governments have the highest level of protection and reliability for free so that their constituents have access to election information and voter registration. Since the project weve provided services to more than 425 local government election websites in 33 states.
1.1.1.1: We released 1.1.1.1 to help fix the foundation of the Internet by building a faster more secure and privacy-centric public DNS resolver. This is available publicly for everyone to use - it is the first consumer-focused service Cloudflare has ever released. Heres the deal - we dont store client IP addresses never ever. We will continue to abide by our privacy commitment and ensure that no user data is sold to advertisers or used to target consumers.
Sound like something youd like to be a part of Wed love to hear from you!
Please note that applicants who progress to the offer stage of the interview process may be asked to attend an in-person interview within one of the Cloudflare Offices or Cloudflare Hubs. More details about this will be available at that stage of the interview process.
This position may require access to information protected under U.S. export control laws including the U.S. Export Administration Regulations. Please note that any offer of employment may be conditioned on your authorization to receive software or technology controlled under these U.S. export laws without sponsorship for an export license.
Cloudflare is proud to be an equal opportunity employer. We are committed to providing equal employment opportunity for all people and place great value in both diversity and inclusiveness. All qualified applicants will be considered for employment without regard to their or any other persons perceived or actual race color religion sex gender gender identity gender expression sexual orientation national origin ancestry citizenship age physical or mental disability medical condition family care status or any other basis protected by law. We are an AA/Veterans/Disabled Employer.
Cloudflare provides reasonable accommodations to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job. Examples of reasonable accommodations include but are not limited to changing the application process providing documents in an alternate format using a sign language interpreter or using specialized equipment. If you require a reasonable accommodation to apply for a job please contact us via e-mail at or via mail at 101 Townsend St. San Francisco CA 94107.
Required Experience:
IC
About Company
Make employees, applications and networks faster and more secure everywhere, while reducing complexity and cost.