Google Cloud Vision API

Name: Cloud Vision API
Brand: Cloud Vision API
Availability: InStock

✓ Official Vendor SpecAI/MLVisionoauth223 EndpointsREST

Install Jentic One Beta

Connect the Cloud Vision API to your agent

Jentic One is a self-hosted execution layer for AI agents. It lets your agent call the Cloud Vision API, or any other public or private API you need. You set the rules, the agent never sees your credentials, and every call is logged.

Two steps, two machines. Install the instance in a safe environment, then register your agent from wherever it runs.

Step 1: Jentic One Host machine

# On the machine that will host your Jentic One instance:
curl -fsSL https://raw.githubusercontent.com/jentic/jentic-one/main/tools/install.sh | sh

Step 2: Agent machine

# On the machine where your agent runs (keep this separate from the instance):
curl -fsSL https://raw.githubusercontent.com/jentic/jentic-one/main/tools/install.sh | sh
jentic register       # connects your agent to your Jentic One instance

Jentic One is in public beta. The setup above keeps your agent separate from the instance, which is what you want before using real credentials: an agent running as the same OS user as Jentic One can read its stored keys directly. Just evaluating? A single local install is fine to start. See the secure deployment guide for the tiers.

Capabilities

What an agent can do with Cloud Vision API.

Extract typed and handwritten text from images and PDFs with full OCR layout

Detect object labels and bounding boxes for inventory and content tagging

Recognize landmarks, logos, and well-known products in user-supplied images

GET STARTED

Start building with Cloud Vision API

Explore with Jentic

View OpenAPI Document

For Agents

Run OCR, label detection, face detection, landmark recognition, and explicit content checks on images and PDFs so an agent can extract structured data from visual content.

Use for: I need to extract text from a scanned invoice, Detect labels in a user-uploaded image for tagging, Check whether an image contains explicit or violent content, Recognize the brand logo in a marketing photo

Not supported: Does not handle video annotation, image generation, or image editing - use for image and PDF analysis (OCR, labels, faces, logos, SafeSearch, product search) only.

Use Cases

Patterns agents use Cloud Vision API for, with concrete tasks.

★ Document Digitization and OCR

Operations and back-office teams convert scanned invoices, contracts, and forms into searchable text using the Vision API's DOCUMENT_TEXT_DETECTION feature. The API returns the full hierarchical layout of pages, blocks, paragraphs, words, and symbols with confidence scores, which the digitization pipeline maps into structured records. Asynchronous batch endpoints handle large multi-page PDFs without blocking caller threads.

Submit a files:asyncBatchAnnotate with DOCUMENT_TEXT_DETECTION on a 200-page PDF in gs://invoices/q3.pdf

User-Generated Image Moderation

Marketplaces and social platforms screen every user-uploaded photo with SafeSearch and label detection before publishing. The images:annotate endpoint returns likelihood ratings for adult, violent, racy, medical, and spoof content alongside detected labels, letting the moderation pipeline auto-block clear violations and route ambiguous cases to human review. Synchronous mode keeps response times suitable for upload flows.

Annotate an image with SAFE_SEARCH_DETECTION and reject if adult or violent likelihood is LIKELY or VERY_LIKELY

Retail Visual Search

Retailers index their product catalog into a Vision Product Search corpus, then accept query images at runtime to return visually similar SKUs ranked by similarity. The productSearch annotate path matches against the configured product set and returns matching product IDs with bounding boxes for each detected object in the query image. This powers in-app 'find similar products' features without training a custom model.

Annotate a customer photo with PRODUCT_SEARCH and return the top three matching SKUs from the home goods product set

AI Agent Image Understanding

An AI agent integrated through Jentic answers prompts like 'what is in this photo?' or 'is this image safe to publish?' by discovering the Vision API by intent search, calling images:annotate with the relevant feature set, and returning the structured response. Because the API uses OAuth 2.0 with the cloud-platform scope, Jentic isolates the token in your Jentic One instance and exposes only a scoped reference.

Search Jentic for analyze an image, load the schema, and call images:annotate with LABEL_DETECTION and SAFE_SEARCH_DETECTION

Key Endpoints

23 endpoints — the cloud vision api performs image and pdf analysis including label detection, ocr, face detection, landmark and logo recognition, explicit content (safesearch) detection, object localization, and product search.

METHOD

PATH

DESCRIPTION

POST

/v1/images:annotate

Synchronous batch annotation of one or more images

POST

/v1/images:asyncBatchAnnotate

Asynchronous batch annotation for large image sets

POST

/v1/files:annotate

Synchronous annotation of multi-page PDF and TIFF files

POST

/v1/files:asyncBatchAnnotate

Asynchronous annotation of large PDF and TIFF documents in Cloud Storage

POST

/v1/images:annotate

Synchronous batch annotation of one or more images

POST

/v1/images:asyncBatchAnnotate

Asynchronous batch annotation for large image sets

POST

/v1/files:annotate

Synchronous annotation of multi-page PDF and TIFF files

POST

/v1/files:asyncBatchAnnotate

Asynchronous annotation of large PDF and TIFF documents in Cloud Storage

Why Jentic?

Three things that make agents converge on Jentic-routed access.

Credential isolation

Your Cloud Vision service-account credential is stored once, encrypted, by your own Jentic One instance and injected at execution time. It never enters the agent's prompt, logs, or context.

Intent-based discovery

Agents search Jentic by intent such as 'extract text from an image' or 'detect labels', and Jentic returns the images:annotate operation with its input schema, including the feature enum and image source options, so the agent calls the right endpoint without browsing the reference docs.

Time to first call

FAQs

Specific to using Cloud Vision API through Jentic.

What authentication does the Cloud Vision API use?

The Cloud Vision API uses OAuth 2.0 with the https://www.googleapis.com/auth/cloud-platform or cloud-vision scope. Through Jentic, the OAuth token is stored encrypted in your Jentic One instance and only a scoped reference is exposed to the agent at execution time.

Can I run OCR on a multi-page PDF with the Cloud Vision API?

Yes. Use POST /v1/files:asyncBatchAnnotate with DOCUMENT_TEXT_DETECTION to OCR a PDF or TIFF stored in Cloud Storage. The async endpoint returns an operation name; the final annotation result is written to a Cloud Storage destination you specify in the request.

What are the rate limits for the Cloud Vision API?

Default project quotas allow 1,800 requests per minute and 16 images per request, with feature-specific image-size and PDF-page caps. Higher quotas can be requested in the Google Cloud Console; pricing is per feature per image.

How do I detect explicit content in an image through Jentic with the Cloud Vision API?

Install Jentic with pip install jentic, search for detect explicit content in image, load the schema for POST /v1/images:annotate, then call it with features set to SAFE_SEARCH_DETECTION and the image source as either a Cloud Storage URI or base64 content. The response includes adult, violent, racy, medical, and spoof likelihood values.

Does the Cloud Vision API support handwriting recognition?

Yes. Use DOCUMENT_TEXT_DETECTION rather than the simpler TEXT_DETECTION feature; DOCUMENT_TEXT_DETECTION is tuned for dense text and handwriting and returns full document layout. Accuracy depends on legibility, contrast, and language.

Why does my Vision API request return INVALID_ARGUMENT for an inline image?

Inline image content must be valid base64-encoded bytes under the 10 MB request limit, and the image format must be one of JPEG, PNG, GIF, BMP, WEBP, RAW, ICO, PDF, or TIFF. For larger files, upload to Cloud Storage and pass the gs:// URI in image.source.imageUri instead.

Can I limit what my agent is allowed to do with the Cloud Vision API?

Yes. Because Jentic One is self-hosted by you, your own rules decide which Cloud Vision operations and credentials the agent may use. Since the image or file and the requested features travel in the request body, you scope by operation and can grant the agent only what it needs, such as images:annotate and files:annotate for synchronous OCR, label, and SafeSearch checks. The async batch operations like images:asyncBatchAnnotate and files:asyncBatchAnnotate are excluded unless you explicitly add them, and the service-account credential is injected at execution time rather than exposed to the agent.

Google Cloud Vision API

Connect the Cloud Vision API to your agent

Capabilities

Start building with Cloud Vision API

Use Cases

Key Endpoints

Why Jentic?

Related APIs

FAQs