Running Genkit on AWS Lambda with Bedrock! 🚀 Xavier Portilla Edo has published a complete guide to deploying AI-powered Genkit flows on AWS Lambda, powered by Amazon Bedrock. What's covered: ✨ Initialize Genkit with the Bedrock plugin for AWS model access 🌊 Build streaming flows that deliver real-time AI responses via Lambda 🛠️ Local development with Serverless Offline 📦 Deploy and invoke flows using the Genkit Client SDK This tutorial is a great showcase of Genkit's "use any cloud" philosophy — making it easy to adopt Genkit wherever your infrastructure already lives. Read the full guide: https://lnkd.in/gRYGjNQf
Genkit
Technology, Information and Internet
San Francisco, CA 679 followers
Genkit is an open-source library with tools to help you build AI-powered experiences
About us
Genkit is an open-source framework for building AI-powered fullstack applications
- Website
-
https://genkit.dev
External link for Genkit
- Industry
- Technology, Information and Internet
- Company size
- 5,001-10,000 employees
- Headquarters
- San Francisco, CA
- Type
- Public Company
Locations
-
Primary
Get directions
San Francisco, CA, US
Employees at Genkit
Updates
-
Running Genkit on AWS Lambda with Bedrock! 🚀 Xavier Portilla Edo has published a complete guide to deploying AI-powered Genkit flows on AWS Lambda, powered by Amazon Bedrock. What's covered: ✨ Initialize Genkit with the Bedrock plugin for AWS model access 🌊 Build streaming flows that deliver real-time AI responses via Lambda 🛠️ Local development with Serverless Offline 📦 Deploy and invoke flows using the Genkit Client SDK This tutorial is a great showcase of Genkit's "use any cloud" philosophy — making it easy to adopt Genkit wherever your infrastructure already lives. Read the full guide: https://lnkd.in/gRYGjNQf
-
Hybrid AI is here for Dart developers 🚀 Sasha Denisov just published genkit_flutter_gemma — a new Genkit Dart plugin that wraps flutter_gemma and brings on-device inference into the Genkit ecosystem. Run Gemma, Llama, DeepSeek, Qwen, Phi, FastVLM, and more — locally across Android, iOS, macOS, Windows, Linux, and Web — using the same Genkit plugin API. Pair it with Jhin Lee genkit_llamadart plugin (GGUF models via llama.cpp) and you have a clear path to hybrid AI apps: ☁️ Cloud providers (Gemini, OpenAI) for heavy reasoning 📱 On-device inference for offline, low-latency, or privacy-sensitive tasks 🔄 Switch between them without changing your flows This is what the Genkit plugin system was designed for — and the community is running with it. https://lnkd.in/g5WtzdKV
I recently wrote about releasing of Genkit Dart. Here's what I've been building on top of that. genkit_flutter_gemma is a new Genkit Dart plugin that wraps flutter_gemma — bringing on-device inference with models in TFLite and LiteRT formats into the Genkit ecosystem. Gemma, Llama, DeepSeek, Qwen, Phi, FastVLM, and others — all running locally on Android, iOS, macOS, Windows, Linux, and Web through the same Genkit API and plugin architecture. Together with Jhin Lee genkit_llamadart plugin for GGUF models, this opens a clear path to building hybrid AI apps through Genkit — combining cloud providers like Gemini or OpenAI with on-device inference in a single application. The Genkit plugin system makes switching between them trivial: same API, same flows, just a different model reference. Want cloud reasoning for complex tasks and local inference for offline, low-latency, or privacy-sensitive features? Now you can — without maintaining two separate AI stacks. https://lnkd.in/d3p9yPWs Thanks to the Genkit team — Christopher Gill, Pavel Jbanov, Abdallah Shaban and others — for building a great foundation. #Genkit #Flutter #Dart #OnDeviceAI #AI #OpenSource #FlutterDev #FlutterGemma #LiteRT #TFLite
-
-
The Genkit Dart community is building some incredible things 🙌 Jhin Lee just shipped genkit_llamadart — a Genkit plugin that brings local LLM execution to Dart using llama.cpp. That means you can now run Llama models entirely on-device, with full privacy, offline support, and zero API costs. Here's what makes this exciting: 🔒 Full privacy — your data never leaves the device 📴 Offline-first — works without an internet connection 💰 Zero API costs — no cloud, no billing surprises 🔌 Seamless integration — same Genkit API and plugin system you already use This is exactly the kind of community contribution that pushes Genkit Dart forward. Check it out 👇
Genkit for #Dart now supports local execution via genkit_llamadart. This integration enables on-device LLMs using llama.cpp, offering total privacy, offline functionality, and zero API costs. Key benefits: - Full Privacy: Data remains on-device. - Offline Capability: Works without internet. - Cost Efficiency: No scaling fees. - Seamless Integration: Genkit ecosystem with local performance. https://lnkd.in/eVpexfGc Flutter Dev Flutter Community
-
-
Build your own AI search CLI with Genkit! 🔍 Xavier Portilla Edo has written a fantastic tutorial on building an interactive CLI chat tool powered by Genkit, Gemini, and Tavily. Here's what you'll learn: 🤖 How to define a web search tool with Tavily 💬 Building an interactive agentic chat loop with Genkit 🛠️ Using the Genkit Dev UI to debug your agents in real time It's a great end-to-end example of Genkit's tool-calling and agentic capabilities applied to a real developer task. Read the full tutorial: https://lnkd.in/gZTxKfAq
-
🚀 Genkit Dart v0.12.0 is here! We've shipped a new release for Dart developers with exciting improvements to our schema library and provider support. ✨ Schemantic now supports bring-your-own-type, giving you full flexibility over schema definitions 🛠️ Upgraded Anthropic & OpenAI SDKs for more robust provider support across platforms ⚠️ Breaking change: The middleware tool hook now returns Part for greater composability in complex pipelines Check the full changelog for details and migration guidance: https://lnkd.in/g9asQYfN
-
We love seeing the community's reaction to new Genkit features! 🎉 Developers across the ecosystem are already exploring and sharing their thoughts on Genkit's latest capabilities. It's incredibly motivating to see the community engage with what we're building. Check out what the community is saying: https://lnkd.in/gKguPHtB
5 days ago, Genkit announced the preview launch of Genkit for Dart. As I had already been exploring Genkit for Flutter Dev apps before, I was really curious about building a full-stack GenAI Flutter app with a Dart backend. So I gave it a try and wrote a new tutorial: “Getting Started with Genkit Dart: Build a Full-Stack AI App with Flutter.” In it, I show how to build an avatar generation app using Genkit for Dart, and how to deploy the backend to Google Cloud Run so your Flutter mobile or web app can call it. https://lnkd.in/dQHWyBPh
-
Stop juggling multiple API keys. Use one Genkit plugin instead. 🔑 This blog post by Alexander Nohe is a great guide to using Vertex AI's Model Garden plugin in Genkit to access Claude, Mistral, Gemini, and Llama from a single plugin — no separate API keys, no separate consoles, no quota headaches. It's a practical, developer-friendly approach to model flexibility, and a fantastic example of the content our community creates. Read the full walkthrough: https://lnkd.in/gvgcESbb
-
The Genkit ecosystem continues to grow! 🚀 We are proud to see the community-built Genkit Java SDK featured on DZone. Xavier Portilla Edo has written a comprehensive guide on building generative AI applications using Java and Genkit. This is a testament to the power of the Genkit community in bringing modern AI tooling to every developer, regardless of their preferred language. Check out the article on DZone: https://lnkd.in/g3f4RzxZ
-
How do you align on prompting for production? 🤝 Effective prompt engineering isn't just about the magic words; it's about the workflow. Google Cloud Samples team at Google Cloud shared how they align on prompts using Genkit to ensure consistency and quality across their entire development team. It's a great look at how Genkit helps teams collaborate on AI-powered features. Read the full article on Dev.to: https://lnkd.in/gEjNxjkx