Skip to content

Pictures and files

Markdown

A picture is read too. A photograph of a receipt can become a receipt with its total and its lines; a boarding pass in Photos can become a flight with its seat; a screenshot of a product page can become the product. Copilka looks at every picture and file you save, says what it thinks it is, and lets you decide.

  1. A look on this Mac, free and offline. Copilka reads any text in the picture and looks for codes: barcodes and QR codes. This uses the Mac’s own recognition and sends nothing anywhere. It happens for every picture, whatever your plan.
  2. Codes are understood. A boarding pass code becomes a flight; a calendar invitation becomes an event; a business card becomes a person; a payment code becomes a receipt; a web address becomes a link; a product barcode becomes a product. The raw contents of a code are dropped once read, and a payment code’s account number is never kept.
  3. A model looks at it. On the subscription, a small copy of the picture, no more than 768 pixels across, is sent to a model together with the words read out of it and any Where to look note. The model returns a short title, a summary, three tags, and its guess at what the picture shows. A file that is not a picture is sent as its preview thumbnail.
  4. Colours are measured here on the Mac: the palette, the size and the format.

A code file saved from disk is read on the Mac, instantly and offline, into its language, its first lines and its length. Nothing of it is sent anywhere.

The same picture saved twice takes the reading of its twin.

A picture stays a picture until you say otherwise. What the reader thinks it might be is kept as a suggestion, and the card grows one button: File as receipt, File as flight, and so on. Hovering explains: This looks like a receipt. or This looks like a flight, read from its boarding pass. or This looks like a screenshot of ikea.com.

In the details panel the suggestion is a sentence with three answers: File as …, Keep as picture, and a menu headed It is really a for choosing something else: Ticket, Flight, Receipt, Event, Product, Place, Person, Book, Film, Music, Article, Recipe, Paper, Link, or Picture.

When more than four pictures are waiting for an answer, the cards go quiet and one bar asks about all of them: Three of these look like receipts. with File them all, Keep as pictures and Review.

Filing a picture as a kind of thing gives it that kind’s reading and its facts, while the picture stays its cover. Filing one as a Link is the one answer that fetches anything: the item takes the address and reads the page. Every answer can be undone with ⌘Z.

To change your mind later, use Read this receipt again in the details panel: its What it is menu lists the kinds and, at the end, Picture, which makes it a plain picture again.

Ask what a picture is, in Settings → Reading, is the switch for the offers. Its own words say it best: A picture of a ticket is a ticket. Copilka reads every picture on this Mac — its words and its codes, free and offline — and where one looks like a ticket, a receipt or a screenshot of a page, it offers to file it as that instead. It never decides for itself. With it off, no offer is shown.

The phone reads pictures the same way, and has a camera and a live scanner to make them: see Saving on iPhone. It shows no File as button; a suggestion appears as the pre-set kind in Read again.

Only the model step sends anything: the downscaled picture or a file’s thumbnail, the words read out of it, and your note. The recognition, the codes, the palette and code files stay on the Mac. See What leaves your device.