Skip to content

Navigation Menu

Appearance settings

View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
View all resources
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  GitHub Stars
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

Uh oh!

There was an error while loading. Please reload this page.

eelpie / grid Public

forked from guardian/grid

Notifications You must be signed in to change notification settings
Fork 0
Star 1

Code
Pull requests 8
Actions
Projects
Security and quality
Insights

Additional navigation options

Code
Pull requests
Actions
Projects
Security and quality
Insights

Thrall embedding - #20

#20

Draft

tonytw1 wants to merge 145 commits into

libvips-croppingeelpie/grid:libvips-croppingfrom

thrall-embeddingeelpie/grid:thrall-embeddingCopy head branch name to clipboard

Conversation Commits145 (145)Checks Files changed

Draft

Thrall embedding#20
tonytw1 wants to merge 145 commits into
libvips-croppingfrom
thrall-embedding

Commits

Commits on Sep 3, 2026

ImageLoader maybeEmbedder is dependant on the optional queue URL and and optional embedding.
tonytw1
committed
c3375ae
MediaAPI config handling of embedder queueUrl is consistent with image loader.
tonytw1
committed
6a6685f
Media API optional embedder consistant with image loader.
tonytw1
committed
2f15dc6
[generalise-embedding-impl] Extract common embedding implementation interface.
tonytw1
committed
9260ce3
[generalise-embedding-impl] createImageEmbeddings requires a mimeType.
tonytw1
committed
6e8dc8e
[generalise-embedding-impl] EmbeddingImplementation returns a full Embedding object rather than List[Float] to push the specific embedding field choice down to the implementations.
tonytw1
committed
d498cc7
Port Bedrock create image embedding back from lambda. Bedrock implements EmbeddingImplementation
tonytw1
committed
db57e8e
createImageEmbedding is available on Embedder interface.
tonytw1
committed
af958c5
Unit
tonytw1
committed
1ee6d80
[generalise-embedding-impl] Embedder takes a general EmbeddingImplementation rather than Bedrock specifically.
tonytw1
committed
b54abfb
[embedding-source] embeddingSourceImageFormat exposed on Embedder so that it can be used to create an embedding source.
tonytw1
committed
5220027
[embedding-source] ImageOperations.createEmbeddingSource to normalise a source image and for input into a prediction end point.
tonytw1
committed
0ad5e8f
[embedding-source] In memory copy. Strips metadata and may not render as well as thumbsnails png flush.
tonytw1
committed
20fb993
[embedding-source] Explicitly strip metadata so that we be sure that observed results are based solely on the pixels.
tonytw1
committed
9bbaa76
[embedding-source] Support optional letter boxing the embedding source image to preserve the aspect ratio of the subjects and (maybe) avoid cropping out of subjects.
tonytw1
committed
cd10b2a
[embedding-source] Increasing the output size for the createEmbeddingSource test helps to reliablity surface the out of order read.
tonytw1
committed
f8d4fca
[send-embedder-sqs-message] Introduce the embedding source S3 bucket to hold formatted source images for embedding.
tonytw1
committed
58192c9
[embedding-source] createEmbeddingSource is file based for consistancy with thumbnail and heap concerns.
tonytw1
committed
2d193de
[thrall-embedding] Placeholder for SQS embed required message consumer in Thrall.
tonytw1
committed
ac0120e
[thrall-embedding] Parse EmbedderMessage
tonytw1
committed
9869607
[thrall-embedding] EmbeddingSqsConsumer gets store and embedder
tonytw1
committed
822b023
[thrall-embedding] Picking up the embed source file from S3 in thrall.
tonytw1
committed
2471e17
[thrall-embedding] Parse embedding source image mimeType.
tonytw1
committed
feed8c1
[thrall-embedding] Make create embedding call and produce an Embedding.
tonytw1
committed
3d0d64f
[thrall-embedding] Send update embed message.
tonytw1
committed
52a3ada
[thrall-embedding] embedding source mimetype is extracted from S3 header.
tonytw1
committed
b287c47
Drop fileType from EmbedderMessage; it is already past on the S3 object metadata.
tonytw1
committed
4a3acb8
[mapping] Provide a geminiEmbedding2 field on Embedding.
tonytw1
committed
c9646c1
[gemini-embedding] Initial Gemini Embedding 2 client.
tonytw1
committed
bcd9ff2
[upstream] testcontainers-localstack 2.0.5 and testcontainers-elasticsearch 2.0.5
tonytw1
committed
c11f6cd
[gemini-embedding] Implement text query to vector
tonytw1
committed
6bbbeea
[gemini-embedding] Use task type on query embedding.
tonytw1
committed
2410538
[gemini-embedding] Revert; worked better without?
tonytw1
committed
eb6e84b
[gemini-embedding] Embedding for uploaded image contains title and description as well as pixels.
tonytw1
committed
a280b8e
[gemini-embedding] Refactor; setup for config.
tonytw1
committed
c175d79
[gemini-embedding] provides embeddingSourceImageFormat.
tonytw1
committed
7446dcb
[gemini-embedding] createImageEmbeddings requires a mimeType.
tonytw1
committed
ebc3560
[gemini-embedding] extends embedding implementation interface.
tonytw1
committed
8aef288
[gemini-embedding] Provide a geminiEmbedding2 mapping with Google's recommended 768 dimensions.
tonytw1
committed
cadf0b2
[gemini-embedding] Define googleCloudEmbedding component to replace Bedrock.
tonytw1
committed
8c980bf
[gemini-embedding] Billing is not size dependant so we can use a large frame.
tonytw1
committed
42428af
[gemini-embedding] Does not need letter boxing.
tonytw1
committed
3084369
[gemini-embedding] Use JPEG
tonytw1
committed
9190062
[gemini-embedding] set taskTypes on embedding request.
tonytw1
committed
0ad33eb
Thrall switches to GCP embedding.
tonytw1
committed
342e8d1
[query] Use geminiEmbedding2 Elastic mapping field.
tonytw1
committed
8a32676
Test
tonytw1
committed
8d25c05
[query] knnSearch mapping field to use is a constant.
tonytw1
committed
e40a188
[query] Switch knn search field to embeddin.geminiEmbedding2.image.
tonytw1
committed
47aedfb
[query] Restrict KNN with similarity filter to prevent long crawls.
tonytw1
committed
3b674c0
[query] Setting up to use similar too as boolean clause of normal search. Extract embedding for image lookup.
tonytw1
committed
bb2cc3c
[query] Pass maybeSimilarToVector down to normal search.
tonytw1
committed
06208d5
[query] knn is constrained to the withFilter query. knn should look like a must filter clause.
tonytw1
committed
8d69023
[query] searchRequest is a normal query or a knn with the query as it's filter.
tonytw1
committed
b3945cf
[query] Ignore similar when building Elastic query from structuredQuery. similar is handled with the knn special case.
tonytw1
committed
0aeaff8
[query] Not needed.
tonytw1
committed
865f986
Happy with numCandiates to be 2 * k given we have a constraint on simalatiry in place.
tonytw1
committed
839c561
Bigger cast?
tonytw1
committed
9d65e6f
[ui] More List This link is conditional on this image having an embedding.
tonytw1
committed
f25e62b
[ui] Clicking More Like This does not need to set the Use AI Search tickbox
tonytw1
committed
6518ea5
[thrall-embedding] Pass uploaded image metadata to the embedder via the SQS message; not ideal for billing and size limits.
tonytw1
committed
766d3ec
[thrall-embedding] Make image metadata from the SQS message availble to create embedding calls.
tonytw1
committed
c7ec19e
Test fixes.
tonytw1
committed
61934fe
Relax / Tighten.
tonytw1
committed
13caf77
Bound the semanticRequest knn by similarity to prevent long explores past the valid matches.
tonytw1
committed
cf81d87
Provide media api config hooks for tuning aiSearchMinimumSimilarity and aiSimilarImagesMinimumSimilarity.
tonytw1
committed
b3f7001
Store the embedding results and project for future reindexing.
tonytw1
committed
deca2d6
[te] fetchEmbeddingResult checkes for file existance.
tonytw1
committed
ce4fc4b
[te] Rename and source key on fetch.
tonytw1
committed
758d843
[te] createEmbeddingsSource moves to ImageUploadOpsDependencies so that Projector can no-op it.
tonytw1
committed
defd361
[te] Clean up; more natural ordering.
tonytw1
committed
0f3976e
[te] Clean up; similar name.
tonytw1
committed
3f05949
[te] Embeddings move to their own bucket for simpler life cycling.
tonytw1
committed
4d59b4c
[te] Standard path.
tonytw1
committed
8c084b6
[te] Embedding are deleted on from the embedding bucket on hard reaping.
tonytw1
committed
1b936c6
[upstream] Clean up; delete unused S3Vectors.
tonytw1
committed
13d43a6
Reindexing from S3. Thrall endpoint to trigger a projection of all S3 images by paginating through S3.
tonytw1
committed
c3e4df1
Reindex process queues project image operations.
tonytw1
committed
1d2b658
Reindex should write projection results as UpsertFromProjectionMessage like the controller end point.
tonytw1
committed
cdd21e0
Reindex logging message.
tonytw1
committed
cf05575
Reindex messages are put into the low priority queue.
tonytw1
committed
76ef291
[reindexing] Form to request reindex of single image.
tonytw1
committed
f91fa04
[reindexing] Reindex from CSV end point.
tonytw1
committed
05d6805
[reindexing] Prompt fort full reindex.
tonytw1
committed
967310b
[reindexing] Combine.
tonytw1
committed
9395c10
[reindexing] Send reindexMessages in batches for faster enqueuing.
tonytw1
committed
bbfef12
Queue reindex requests by most recently last modified first.
tonytw1
committed
ec9fccd
Reindex kinesis stream runs separately with it's own concurrency.
tonytw1
committed
b53e977
CSV reindex is batched and put onto the low priority queue.
tonytw1
committed
7b25ae4
reindexMessage processing needs to throw to be retried.
tonytw1
committed
4e3cf4a
Spike; simpler SyndicationFilter
tonytw1
committed
dcf5266
Add syndicationStatus as a filter in the q parameter so that it can be selected from the UI.
tonytw1
committed
c697dc5
Filter test.
tonytw1
committed
2f5bfa6
Queued for syndication must be syndicatableCategory / owned not just leased.
tonytw1
committed
42bb38b
Image.syndicationStatus aligns with syndicationFilter on not needing RCS rights acquired.
tonytw1
committed
c9b601c
Image.syndicationStatus aligns with syndicationFilter on defination of owned photograph.
tonytw1
committed
f2677e4
Update ImageTest syndication tests to match isOwned syndication rights definition.
tonytw1
committed
079dcb5
Update ElasticSearchTest syndication tests to match isOwned syndication rights definition.
tonytw1
committed
1ef13f8
syndicationStatus query suggestion in UI.
tonytw1
committed
a9b33b5
Update test; we do not syndicate replaced images.
tonytw1
committed
89e4257
Get getCssColour supports sub folder colours overriding parent colours and the default.
tonytw1
committed
5868df8
Extract collection paths for reuse in CssColours.
tonytw1
committed
f38b7af
Recent print usages highlight only counts recent published usages.
tonytw1
committed
ac84462
Refactor; image screen usage panel considers whole usage when making a is recent decision.
tonytw1
committed
d93b0ed
Image screen usage panel does not highlight non published print uses as recent.
tonytw1
committed
0b4b5ef
Update Observer collection colours.
tonytw1
committed
042b666
Fork Tortoise usage rights with minimal config.
tonytw1
committed
7906278
Add GNM as an agency.
tonytw1
committed
604e438
Set Tortoise contact photographers.
tonytw1
committed
0aef750
Chris Riddell is an Observer contacted illustrator.
tonytw1
committed
78f3896
Remove Dave Benett Collection from list of explicity pay to use Getty collections.
tonytw1
committed
059776f
migrationStatusRefresher interval.
tonytw1
committed
0a5fac9
Thrall "/thrall" prefix via explicit Routes.withPrefix because play.http.context does not work.
tonytw1
committed
5b08a57
No +nocsrf on thrall UI routes.
tonytw1
committed
cbcd4a0
Usages updates should go on the main kinesis stream so that they are not stuck behind reindex requests.
tonytw1
committed
23ea940
Revert "remove preview view"
tonytw1
committed
6e61f16
Fixes stickiness when paging through preview images.
tonytw1
committed
fc167d8
Immutable placeholders look out of place; change to allow ids to update when the preview image changes.
tonytw1
committed
4f58895
Fixes inSelectionMode not been past to ui-preview-image-large. Fixes select check box is clobbered by click through to single image screen.
tonytw1
committed
e199db5
Allow more than 1 item to be selected from preview mode. Allow range selects from preview.
tonytw1
committed
e13a21d
Always show reapable filter.
tonytw1
committed
855267e
Media API offers an end point for downloading the master crop.
tonytw1
committed
4302d4a
Kahana picks up master asset for download.
tonytw1
committed
0b087af
Enable iPhone HEIC support.
tonytw1
committed
530be2f
Explicit human-readable crop display names.
tonytw1
committed
174a14b
Register 3:2 as a known aspect ratio so that in can be cleaned with the existing off by 1 protections.
tonytw1
committed
f83fe98
Register 3:2 as a crop option.
tonytw1
committed
ab87e22
Observer wants 5:3 crop options.
tonytw1
committed
ff25806
Crops download as the original filename falling back to Grid image id if no filename is available.
tonytw1
committed
45f8608
Set start dates for publication photographers to 22 April 2025 for repeatable reindexing.
tonytw1
committed
ba6a61c
Logging. Projected logs the media-id not the whole response.
tonytw1
committed
975685a
Lower concurrency on reindex.
tonytw1
committed
b4d7b59
Log ignored reindex ids.
tonytw1
committed
f362d15
refactor; continueScrolling rename to be general.
tonytw1
committed
aa0f833
refactor; continueScrolling and closeScroll move to ElasticSearchClient for reuse.
tonytw1
committed
8f2ae92
End point to output all currently held document ids to a tmp file.
tonytw1
committed
e2bb9b3
Clarifying rename; this parameter is the number of retries after the initial attempt; not the total number of attempts.
tonytw1
committed
6a81892
Fixes 4775
tonytw1
committed
bf4ed40
Remove duplicate toFileMetadata which only populates log markers.
tonytw1
committed
eef65e8
Run media-api tests using docker in docker elasticsearch.
tonytw1
committed
32af2bf
Run collections and leases tests.
tonytw1
committed
f6a5466
Combine.
tonytw1
committed
2021633
Revert "Apply circular mask by default"
tonytw1
committed
f9ddf5a
Claude. Bucket config moves to a nest object so that optional bucket fields can be configured.
tonytw1
committed
4147993
Use static S3 credentials if s3 end point has been overridden.
tonytw1
committed
aeff64a

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.