# ggml

**Source:** https://www.startuphub.ai/startups/ggml
**Profile type:** Startup

> A C/C++ tensor library for efficient machine learning inference on consumer hardware.

## About

ggml.ai is a company founded to support the development of ggml, a tensor library for machine learning that enables large models and high performance on commodity hardware. ggml is used by projects like llama.cpp and whisper.cpp, offering a low-level, cross-platform implementation with integer quantization support and broad hardware compatibility. The company's development is open-source under the MIT license, with a focus on simplicity and encouraging experimentation.

## Key facts

- **Slug:** ggml
- **Website:** https://ggml.ai/
- **Founded:** 2021
- **Operating status:** Active
- **Sectors / tags:** Foundation Model, Large Language Model, AI Infrastructure, Edge AI, On-Device AI, Machine Learning, Open Source, Developer Tools, Transformer Architecture, Machine Learning Infrastructure, MLOps
- **Social:**
  - GitHub: https://github.com/ggml-org

## Frequently asked

### What does ggml do?

ggml.ai is a company founded to support the development of ggml, a tensor library for machine learning that enables large models and high performance on commodity hardware. ggml is used by projects like llama.cpp and whisper.cpp, offering a low-level, cross-platform implementation with integer quantization support and broad hardware compatibility. The company's development is open-source under the MIT license, with a focus on simplicity and encouraging experimentation.

### When was ggml founded?

ggml was founded in 2021.

### What industry does ggml operate in?

ggml operates in Foundation Model, Large Language Model, AI Infrastructure, Edge AI, On-Device AI, Machine Learning.

## JSON-LD

Structured data aligned with this page's `<script type="application/ld+json">` (included when the profile is server-rendered).

```json
{
  "@context": "https://schema.org",
  "@graph": [
    {
      "@type": "BreadcrumbList",
      "itemListElement": [
        {
          "@type": "ListItem",
          "position": 1,
          "name": "Home",
          "item": "https://www.startuphub.ai"
        },
        {
          "@type": "ListItem",
          "position": 2,
          "name": "Startups",
          "item": "https://www.startuphub.ai/startups"
        },
        {
          "@type": "ListItem",
          "position": 3,
          "name": "ggml",
          "item": "https://www.startuphub.ai/startups/ggml"
        }
      ]
    },
    {
      "@type": "ProfilePage",
      "@id": "https://www.startuphub.ai/startups/ggml#webpage",
      "url": "https://www.startuphub.ai/startups/ggml",
      "name": "ggml - AI Startup Profile | StartupHub.ai",
      "description": "This is the official profile of ggml. ggml is a startup founded in 2021, operating in Foundation Model and Large Language Model. A C/C++ tensor library for efficient machine learning inference on consumer hardware.",
      "dateModified": "2026-07-23T03:20:28.172+00:00",
      "mainEntity": {
        "@id": "https://www.startuphub.ai/startups/ggml#organization"
      }
    },
    {
      "@type": "Organization",
      "@id": "https://www.startuphub.ai/startups/ggml#organization",
      "name": "ggml",
      "url": "https://ggml.ai/",
      "description": "This is the official profile of ggml. ggml is a startup founded in 2021, operating in Foundation Model and Large Language Model. A C/C++ tensor library for efficient machine learning inference on consumer hardware.",
      "sameAs": [
        "https://github.com/ggml-org",
        "https://www.startuphub.ai/startups/ggml"
      ],
      "foundingDate": "2021-01-01",
      "knowsAbout": [
        "Foundation Model",
        "Large Language Model",
        "AI Infrastructure",
        "Edge AI",
        "On-Device AI",
        "Machine Learning",
        "Open Source",
        "Developer Tools",
        "Transformer Architecture",
        "Machine Learning Infrastructure",
        "MLOps"
      ]
    },
    {
      "@type": "Product",
      "@id": "https://www.startuphub.ai/startups/ggml#profile-assessment",
      "name": "ggml - StartupHub.ai Profile Assessment",
      "url": "https://www.startuphub.ai/startups/ggml",
      "category": "Foundation Model",
      "description": "This is the official profile of ggml. ggml is a startup founded in 2021, operating in Foundation Model and Large Language Model. A C/C++ tensor library for efficient machine learning inference on consumer hardware. Agent Readiness score: 22/100. Full audit: https://www.startuphub.ai/startups/ggml/agent-readiness",
      "brand": {
        "@type": "Brand",
        "name": "ggml"
      },
      "review": {
        "@type": "Review",
        "author": {
          "@type": "Organization",
          "name": "StartupHub.ai"
        },
        "datePublished": "2026-07-23",
        "name": "ggml - Profile Score 20/100",
        "reviewBody": "This is the official profile of ggml. ggml is a startup founded in 2021, operating in Foundation Model and Large Language Model. A C/C++ tensor library for efficient machine learning inference on consumer hardware. Agent Readiness score: 22/100. Full audit: https://www.startuphub.ai/startups/ggml/agent-readiness",
        "reviewRating": {
          "@type": "Rating",
          "ratingValue": 20,
          "bestRating": 100,
          "worstRating": 0
        }
      }
    }
  ]
}
```