OPTI-PORTAL-TECH OPTI-PORTAL-TECH
‹ Back to the hub

Understanding Tech

Plain-English visual guides to the systems behind modern technology: what language models actually do, how APIs connect software, how tokens are counted, what cloud infrastructure provides and how data moves between services. No mysticism, no panic and no sales fog—just enough understanding to make informed decisions.

What is an LLM?

A very well-read prediction engine

A large language model is not a database of finished answers and it does not understand the world in the same way a person does. It processes the text supplied so far and predicts the most likely piece of text to come next. That prediction is added to the sequence, then the process runs again.

Repeated rapidly, using patterns learned from enormous amounts of training material, this simple cycle can produce fluent explanations, code, summaries and conversation. The result can sound confident and intelligent, but it is still a generated prediction—not automatic proof that the answer is true.

Your input "The cat sat on the …" The model compares possible next tokens Selected token "mat" — highest score the selected token is added to the sequence and the cycle repeats

Tokens

The units models read, write and count

Language models usually do not process text as complete words. Instead, text is divided into smaller units called tokens. A short word may be one token. A longer or unusual word may be split into several. Spaces, punctuation and fragments can also affect the count.

Tokens determine how much text a model can consider at once—the "context window". With many commercial AI services, they also help determine the cost: input tokens are sent to the model and output tokens are generated in the reply. Locally operated models still use tokens, but there may be no external per-token bill. The cost is instead carried by your own hardware, electricity and maintenance.

"Understanding technology properly" becomes: Under standing technology proper ly 5 tokens in; the reply is generated token by token. Cloud services often bill by usage — local systems run on hardware you control.

What is an API?

An agreed way for software to ask for something — a hatch in the wall

An API is a defined way for one piece of software to communicate with another. Your application sends a request in an agreed format. The receiving service checks it, performs the requested operation and sends a response back — like a serving hatch with an agreed order form.

The service might be on the same machine, on another computer in your building or in a provider's datacentre. An API does not automatically mean cloud, AI or third-party access—it is simply the contract used by the two systems to communicate. When an application uses a hosted AI model, an API is usually the route through which the prompt is sent and the generated response returned.

Your application creates a request request response: data or status The API format, permissions, actions The service processes the request

Cloud services

Someone else's computer, rented by the slice

"The cloud" is a broad name for computing resources delivered from remote datacentres. Instead of purchasing and maintaining every server yourself, you can rent processing power, storage, databases and other services as needed. This can provide excellent availability, rapid deployment and the ability to scale without buying a room full of equipment.

Cloud services are not inherently better or worse than local systems. The trade-off is that part of your operation depends on another organisation's infrastructure, pricing, security controls, terms and jurisdiction. This website uses rented infrastructure too. The important question is not whether cloud is good or bad—it is deciding what belongs there, what should remain local and what controls are required.

Your devices home, office or mobile the internet Cloud provider their racks your slice agreed terms

How many products use hosted AI

The application and the model may come from different companies

Many AI-enabled products do not operate their own foundation model. Instead, the product provides the interface, instructions, workflows, business rules, security and integrations, while calling a larger model through an API. The model provider generates part of the result and charges the product company according to usage. The product company may then charge a subscription to cover that usage as well as its own infrastructure, development and support.

That arrangement is entirely legitimate. The important questions are what information leaves the application, which providers receive it, how long it is retained and whether it may be used for training or service improvement.

You submit a request application request The product workflow, controls, UX model API call Model provider processes it under agreed data terms Usage contributes to the service cost. Worth asking: what leaves the app, who receives it, and is it used for training?

The questions behind the service

What to ask before trusting a technology provider

None of this makes cloud services, subscriptions or AI products inherently untrustworthy. Infrastructure, development, support and model processing cost real money. The important issue is whether the exchange is explained clearly.

A service may be funded by subscriptions, usage charges, advertising, analytics, data processing or a mixture of these. Policies should make it possible to understand what is collected, why it is needed, where it travels and what control you retain.

Training a model on general patterns is one question. Retaining private customer material, reproducing distinctive work or using customer inputs to improve a competing service raises different questions and should not be hidden behind vague language.

Logs and human review

Are prompts and responses stored? Can staff or contractors read them?

Telemetry

What usage and device information is collected? Is it necessary for the service?

Third-party processors

Which other companies receive the data? In which countries is it processed?

Training and improvement

Is customer content used to train models or improve products? Can this be disabled?

Ownership and outputs

Who retains rights to submitted material and generated results? Could distinctive content appear elsewhere?

Retention and deletion

How long is the information kept? Does deletion include backups and derived records?

The sensible defence is not fear. It is knowing what you agreed to. A provider that explains the arrangement plainly is usually easier to trust than one hiding behind broad promises.

Local, cloud or hybrid

Choose the architecture that fits the job

Modern software does not have to live entirely in one provider's cloud. Open models, business tools, media systems and automations can often run on hardware in your home or workplace. This can provide greater control, predictable operating costs and the option to keep sensitive information on-site.

Cloud services remain useful for remote access, backups, collaboration, heavy processing and scaling. A hybrid system can keep private or time-critical functions local while using hosted services where they provide a genuine advantage.

Running something locally does not remove legal or security responsibilities. Personal data still needs appropriate protection, access control, retention rules and lawful handling. You must also respect the licences attached to models, datasets and software.

The aim is not to reject subscriptions or cloud infrastructure. It is to avoid unnecessary dependency and build the right balance of ownership, convenience, cost and resilience.

Need help deciding what should run locally, what belongs in the cloud and how the pieces should connect? Opti-Gen Core Systems designs local, hosted and hybrid systems around the actual job—not around a fashionable architecture. Head back to the hub and open any service badge for the detail and a price estimate.

Page status: Education Guide v1. These guides are introductory explanations rather than complete technical or legal advice. They are not sponsored or paywalled. The page may use limited, privacy-conscious server logs required for security and reliable operation. Any additional analytics or tracking will be disclosed clearly.