Senior AI Architect – Azure & Cloud AI

Location: Dallas, Texas | Chicago, Illinois | New York, USA
Job Type: Full-Time | Professional
Education Required: Bachelor’s Degree
Preferred Education: Master’s Degree
Company: IBM Consulting

Job Summary

IBM Consulting is seeking a highly experienced Senior AI Architect – Azure & Cloud AI to join its rapidly growing AI practice. This is a senior-level, client-facing position focused on delivering enterprise-scale AI transformation initiatives across cloud and hybrid environments.

As a trusted technical leader, you will define AI strategy, establish enterprise architecture standards, and guide the implementation of scalable, secure, and governed AI solutions. You will work closely with executive stakeholders, business leaders, data teams, and engineering organizations to ensure AI investments align with measurable business outcomes.

This role is ideal for professionals with extensive experience in Azure AI, Agentic AI, Large Language Models (LLMs), cloud architecture, AI governance, and enterprise solution delivery.

Key Responsibilities

AI Strategy & Technical Leadership

• Serve as the primary technical authority across complex AI transformation programs.
• Define and govern enterprise AI architecture standards and best practices.
• Establish architectural vision and technical direction across multiple AI workstreams.
• Develop reusable reference architectures, frameworks, and accelerators.
• Mentor architects, engineers, and AI practitioners on Azure AI technologies and emerging innovations.
• Drive AI adoption strategies that align with enterprise business goals.

Client Engagement & Enterprise Architecture

• Lead architecture workshops, design sessions, and stakeholder engagements.
• Translate business requirements into scalable and secure AI-powered solutions.
• Present technical recommendations to both executive and technical audiences.
• Align AI use cases with measurable business value and ROI.
• Ensure governance, compliance, security, and operational standards are incorporated from project inception.

Azure AI Solution Architecture

• Architect enterprise AI platforms using:
  • Azure OpenAI
  • Azure Machine Learning (Azure ML)
  • Azure Data Services
  • Enterprise Data Platforms
• Define architecture standards for:
  • Model deployment
  • Prompt engineering
  • Data integration
  • AI observability
  • Monitoring and governance
• Design scalable operating models for AI industrialization, including deployment, support, governance, and lifecycle management.

Agentic AI & Enterprise AI Integration

• Design and implement Agentic AI architectures.
• Leverage Model Context Protocols (MCPs) for secure integration between:
  • AI agents
  • Enterprise applications
  • Data platforms
  • Business systems
• Develop orchestration frameworks and guardrails for agentic workflows.
• Implement human-in-the-loop controls, auditability, and AI governance mechanisms.
• Enable interoperability and extensibility across enterprise AI ecosystems.

Enterprise Delivery & Governance

• Ensure AI solutions meet enterprise security, compliance, and reliability requirements.
• Collaborate with business, engineering, security, and data teams.
• Support AI platform strategy, architecture reviews, vendor selection, and governance initiatives.
• Drive adoption of enterprise AI best practices and responsible AI standards.

Required Qualifications

Education

• Bachelor’s Degree (Required)
• Master’s Degree (Preferred)

Experience

• 8+ years of experience designing and delivering enterprise-scale AI and Agentic AI solutions.
• Proven experience implementing AI solutions across cloud and hybrid environments.
• Extensive expertise in Azure and AWS cloud platforms.

Technical Skills

AI & Cloud Architecture

• Azure OpenAI
• Azure Machine Learning (Azure ML)
• Azure AI Services
• AWS AI & Cloud Services
• Enterprise AI Platform Architecture

Large Language Models & Agentic AI

• LLM-powered application development
• Agentic AI architecture design
• Multi-agent orchestration
• Tool calling frameworks
• Memory management
• Model Context Protocols (MCP)
• Human-in-the-loop architectures

AI Frameworks & Development

• LangChain
• LangGraph
• Retrieval-Augmented Generation (RAG)
• Prompt Engineering
• AI Workflow Automation

AI Operations & Governance

• AI Industrialization
• Model Lifecycle Management (ML Ops)
• CI/CD for AI Systems
• AI Monitoring & Observability
• Evaluation Frameworks
• Prompt & Version Management
• Guardrail Frameworks
• Responsible AI Practices

Enterprise Integration

• APIs and Microservices
• Enterprise Applications
• Vector Databases
• Workflow Automation Platforms
• Data Integration Solutions

Preferred Skills

• Experience with Agentic AI frameworks such as:
  • LangChain
  • AutoGen
  • Semantic Kernel
• Experience with Microsoft data platforms:
  • Azure Synapse Analytics
  • Azure Data Factory
  • Microsoft Fabric
• Knowledge of:
  • Responsible AI
  • AI Governance
  • Enterprise Security Frameworks
  • Regulatory Compliance Requirements

Preferred Certifications

• Azure Solutions Architect Expert
• Azure AI Engineer Associate
• Other Microsoft Azure Certifications

Why Join IBM Consulting?

IBM Consulting helps organizations transform their businesses through AI, cloud computing, and emerging technologies. You will work alongside industry-leading experts and global clients to solve complex business challenges using innovative AI solutions.

Benefits & Perks

Eligible employees may receive access to:

Health & Wellness Benefits

• Medical Insurance
• Prescription Drug Coverage
• Dental Insurance
• Vision Coverage
• Mental Health & Well-being Programs

Financial Benefits

• 401(k) Program
• Cash Balance Pension Plan
• IBM Employee Stock Purchase Plan (ESPP)
• Life Insurance
• Financial Counseling
• Short-Term Disability Coverage
• Long-Term Disability Coverage
• Performance-Based Incentive Programs

Paid Time Off

• 12 Paid Holidays
• Minimum 56 Hours Sick Leave
• 120 Hours Vacation
• 12 Weeks Parental Bonding Leave
• Paid Family Care Leave Programs

Learning & Development

• AI-powered personalized learning platform
• Professional certification support
• Continuous technical training
• Career development opportunities

Diversity & Inclusion

• Employee Resource Groups
• Volunteer & Community Programs
• Retail, Service & Experience Discounts
• Inclusive and collaborative workplace culture

Important Employment Information

Visa Sponsorship

IBM will not provide visa sponsorship for this position now or in the future. Applicants must be authorized to work in the United States without requiring current or future visa sponsorship.

Compensation

Compensation will vary based on:

• Skills and qualifications
• Professional experience
• Geographic location
• Employment classification

Benefits and compensation may be adjusted for part-time employees and individuals joining during the calendar year.

Equal Opportunity Employer

IBM is committed to creating a diverse and inclusive workplace. Qualified applicants will receive consideration for employment regardless of race, color, religion, sex, gender identity, sexual orientation, national origin, disability, age, veteran status, genetic information, neurodiversity, citizenship status, or any other protected characteristic under applicable law.