Signal Detail

inference

This is a raw crawl record from GitHub, currently mapped to #1 on the Newcomers board.

GitHubNEWApr 21, 21:00

Record Summary

Newcomers #1

github+hackernews+rss

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API. Current movement: NEW. Note: "First time on the board".

Score72
Confidence78%
Surge+9%
Captured atApr 21, 21:00
GitHubartificial-intelligencechatglm
Current tool mapping
Captured nameinference

This is the name captured in the original signal at crawl time.

Current display nameinference

The system default name is still in use.

Current websiteinference.readthedocs.io

The system default website is still in use.

Current categoryAI Coding

The system default category is still in use.

Source snapshot
GitHubxorbitsai/inference
github.com

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Author / Publisherxorbitsai
Published atApr 21, 20:59
PythonStars 9251Forks 821
Page snapshot
GitHubGitHub - xorbitsai/inference: Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Fetched

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API. - xorbitsai/inference

Fetched atApr 21, 21:00
Published atWaiting for sync
Domaingithub.com
HTTP status200
AuthorNot recorded
Cache statusFresh cache
This crawl record has already generated a matching evidence card on the tool detail page, so you can jump straight back to it.
Structured fields
Repositoryxorbitsai/inference
LanguagePython
Stars9251
Forks821
Watchers9251
Issues51
Updated At2026-04-21T20:59:24Z
Aggregated Source Count1

Raw Payload

Raw crawl payload

{
  "entity_key": "inference.readthedocs.io",
  "source_count": 1,
  "providers": [
    {
      "provider_name": "github",
      "slug": "github-xorbitsai-inference",
      "external_id": "653496050",
      "external_url": "https://github.com/xorbitsai/inference",
      "metric_value": 12112,
      "payload": {
        "id": 653496050,
        "node_id": "R_kgDOJvOO8g",
        "name": "inference",
        "full_name": "xorbitsai/inference",
        "private": false,
        "owner": {
          "login": "xorbitsai",
          "id": 109655068,
          "node_id": "O_kgDOBok0HA",
          "avatar_url": "https://avatars.githubusercontent.com/u/109655068?v=4",
          "gravatar_id": "",
          "url": "https://api.github.com/users/xorbitsai",
          "html_url": "https://github.com/xorbitsai",
          "followers_url": "https://api.github.com/users/xorbitsai/followers",
          "following_url": "https://api.github.com/users/xorbitsai/following{/other_user}",
          "gists_url": "https://api.github.com/users/xorbitsai/gists{/gist_id}",
          "starred_url": "https://api.github.com/users/xorbitsai/starred{/owner}{/repo}",
          "subscriptions_url": "https://api.github.com/users/xorbitsai/subscriptions",
          "organizations_url": "https://api.github.com/users/xorbitsai/orgs",
          "repos_url": "https://api.github.com/users/xorbitsai/repos",
          "events_url": "https://api.github.com/users/xorbitsai/events{/privacy}",
          "received_events_url": "https://api.github.com/users/xorbitsai/received_events",
          "type": "Organization",
          "user_view_type": "public",
          "site_admin": false
        },
        "html_url": "https://github.com/xorbitsai/inference",
        "description": "Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.",
        "fork": false,
        "url": "https://api.github.com/repos/xorbitsai/inference",
        "forks_url": "https://api.github.com/repos/xorbitsai/inference/forks",
        "keys_url": "https://api.github.com/repos/xorbitsai/inference/keys{/key_id}",
        "collaborators_url": "https://api.github.com/repos/xorbitsai/inference/collaborators{/collaborator}",
        "teams_url": "https://api.github.com/repos/xorbitsai/inference/teams",
        "hooks_url": "https://api.github.com/repos/xorbitsai/inference/hooks",
        "issue_events_url": "https://api.github.com/repos/xorbitsai/inference/issues/events{/number}",
        "events_url": "https://api.github.com/repos/xorbitsai/inference/events",
        "assignees_url": "https://api.github.com/repos/xorbitsai/inference/assignees{/user}",
        "branches_url": "https://api.github.com/repos/xorbitsai/inference/branches{/branch}",
        "tags_url": "https://api.github.com/repos/xorbitsai/inference/tags",
        "blobs_url": "https://api.github.com/repos/xorbitsai/inference/git/blobs{/sha}",
        "git_tags_url": "https://api.github.com/repos/xorbitsai/inference/git/tags{/sha}",
        "git_refs_url": "https://api.github.com/repos/xorbitsai/inference/git/refs{/sha}",
        "trees_url": "https://api.github.com/repos/xorbitsai/inference/git/trees{/sha}",
        "statuses_url": "https://api.github.com/repos/xorbitsai/inference/statuses/{sha}",
        "languages_url": "https://api.github.com/repos/xorbitsai/inference/languages",
        "stargazers_url": "https://api.github.com/repos/xorbitsai/inference/stargazers",
        "contributors_url": "https://api.github.com/repos/xorbitsai/inference/contributors",
        "subscribers_url": "https://api.github.com/repos/xorbitsai/inference/subscribers",
        "subscription_url": "https://api.github.com/repos/xorbitsai/inference/subscription",
        "commits_url": "https://api.github.com/repos/xorbitsai/inference/commits{/sha}",
        "git_commits_url": "https://api.github.com/repos/xorbitsai/inference/git/commits{/sha}",
        "comments_url": "https://api.github.com/repos/xorbitsai/inference/comments{/number}",
        "issue_comment_url": "https://api.github.com/repos/xorbitsai/inference/issues/comments{/number}",
        "contents_url": "https://api.github.com/repos/xorbitsai/inference/contents/{+path}",
        "compare_url": "https://api.github.com/repos/xorbitsai/inference/compare/{base}...{head}",
        "merges_url": "https://api.github.com/repos/xorbitsai/inference/merges",
        "archive_url": "https://api.github.com/repos/xorbitsai/inference/{archive_format}{/ref}",
        "downloads_url": "https://api.github.com/repos/xorbitsai/inference/downloads",
        "issues_url": "https://api.github.com/repos/xorbitsai/inference/issues{/number}",
        "pulls_url": "https://api.github.com/repos/xorbitsai/inference/pulls{/number}",
        "milestones_url": "https://api.github.com/repos/xorbitsai/inference/milestones{/number}",
        "notifications_url": "https://api.github.com/repos/xorbitsai/inference/notifications{?since,all,participating}",
        "labels_url": "https://api.github.com/repos/xorbitsai/inference/labels{/name}",
        "releases_url": "https://api.github.com/repos/xorbitsai/inference/releases{/id}",
        "deployments_url": "https://api.github.com/repos/xorbitsai/inference/deployments",
        "created_at": "2023-06-14T07:05:04Z",
        "updated_at": "2026-04-21T20:59:24Z",
        "pushed_at": "2026-04-21T20:59:20Z",
        "git_url": "git://github.com/xorbitsai/inference.git",
        "ssh_url": "git@github.com:xorbitsai/inference.git",
        "clone_url": "https://github.com/xorbitsai/inference.git",
        "svn_url": "https://github.com/xorbitsai/inference",
        "homepage": "https://inference.readthedocs.io",
        "size": 73094,
        "stargazers_count": 9251,
        "watchers_count": 9251,
        "language": "Python",
        "has_issues": true,
        "has_projects": true,
        "has_downloads": true,
        "has_wiki": true,
        "has_pages": false,
        "has_discussions": false,
        "forks_count": 821,
        "mirror_url": null,
        "archived": false,
        "disabled": false,
        "open_issues_count": 51,
        "license": {
          "key": "apache-2.0",
          "name": "Apache License 2.0",
          "spdx_id": "Apache-2.0",
          "url": "https://api.github.com/licenses/apache-2.0",
          "node_id": "MDc6TGljZW5zZTI="
        },
        "allow_forking": true,
        "is_template": false,
        "web_commit_signoff_required": false,
        "has_pull_requests": true,
        "pull_request_creation_policy": "all",
        "topics": [
          "artificial-intelligence",
          "chatglm",
          "deployment",
          "flan-t5",
          "gemma",
          "ggml",
          "glm4",
          "inference",
          "llama",
          "llama3",
          "llamacpp",
          "llm",
          "machine-learning",
          "mistral",
          "openai-api",
          "pytorch",
          "qwen",
          "vllm",
          "whisper",
          "wizardlm"
        ],
        "visibility": "public",
        "forks": 821,
        "open_issues": 51,
        "watchers": 9251,
        "default_branch": "main",
        "temp_clone_token": null,
        "custom_properties": {},
        "organization": {
          "login": "xorbitsai",
          "id": 109655068,
          "node_id": "O_kgDOBok0HA",
          "avatar_url": "https://avatars.githubusercontent.com/u/109655068?v=4",
          "gravatar_id": "",
          "url": "https://api.github.com/users/xorbitsai",
          "html_url": "https://github.com/xorbitsai",
          "followers_url": "https://api.github.com/users/xorbitsai/followers",
          "following_url": "https://api.github.com/users/xorbitsai/following{/other_user}",
          "gists_url": "https://api.github.com/users/xorbitsai/gists{/gist_id}",
          "starred_url": "https://api.github.com/users/xorbitsai/starred{/owner}{/repo}",
          "subscriptions_url": "https://api.github.com/users/xorbitsai/subscriptions",
          "organizations_url": "https://api.github.com/users/xorbitsai/orgs",
          "repos_url": "https://api.github.com/users/xorbitsai/repos",
          "events_url": "https://api.github.com/users/xorbitsai/events{/privacy}",
          "received_events_url": "https://api.github.com/users/xorbitsai/received_events",
          "type": "Organization",
          "user_view_type": "public",
          "site_admin": false
        },
        "network_count": 821,
        "subscribers_count": 61
      }
    }
  ]
}