iiinova — where your digital self keeps evolving

Piergiorgio Lucidi @pjlucidi.bsky.social · 03/10/2026

Toxic PDFs crashing your RAG pipeline? 💥 OpenCrawling now runs Apache Tika 4.1.0 with PipesForkParser process isolation! • Isolated child JVMs • 30s watchdog timeouts • Bounded heaps • Zero-Trust Zip Slip defense 👉 opencrawling.org/blog/introdu... #ApacheTika #DataEngineering #OpenSource

010

Piergiorgio Lucidi @pjlucidi.bsky.social · 03/10/2026

People ask: Michael, how do we feed Alfresco, Documentum & FileNet into AI? 1 Explain it like I’m five! 2 We built the OASIS CMIS Connector. Java 25, Zero-Trust ACLs... That’s what she said. 👉 opencrawling.org/blog/introdu... #TheOffice #CMIS #EnterpriseAI #OpenCrawling #RAG #Java25 #OpenSource

010

Reposted by Piergiorgio Lucidi

Apache Software Foundation (The ASF) @apache.org · 02/10/2026

Apache Tika 4.0.0 is now available for download: buff.ly/JsVurMl Tika is a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries.

021

Piergiorgio Lucidi @pjlucidi.bsky.social · 02/10/2026

Enterprise knowledge lives in workflows, not just static PDFs! ⚡ Alfresco Process Services is now native in OpenCrawling: • Active & historic BPMN crawls • Dynamic typed variables • Candidate group ACLs • Secure MCP Server 👉 opencrawling.org/blog/introdu... #AI #RAG #BPMN #OpenSource

010

Piergiorgio Lucidi @pjlucidi.bsky.social · 01/10/2026

Crawl once, fan out everywhere! 🌊⚡ Apache SeaTunnel is now native in OpenCrawling: • Fan out to 100+ targets (Iceberg, ClickHouse, Milvus, Qdrant) • Decoupled Kafka stream + Zeta REST v2 • CDC DELETE tombstones to prevent RAG hallucinations opencrawling.org/blog/introdu... #AI #RAG

000

Piergiorgio Lucidi @pjlucidi.bsky.social · 29/09/2026

Scale enterprise RAG with web crawling! 🕸️ Apache StormCrawler is now native in OpenCrawling: • StormCrawler 3.7 & Storm 3.1 • Dual-stream UPSERT & DELETE tombstones • Java 25 Virtual Threads Read more: opencrawling.org/blog/introdu... #AI #RAG

010

Piergiorgio Lucidi @pjlucidi.bsky.social · 24/09/2026

Tired of deploying heavy search clusters for RAG? ⚡ Introducing the Luxir Output Connector in OpenCrawling! 🚀 ✔ 1024-dim dense vector kNN + BM25 hybrid ranking ✔ Zero client dependencies ✔ OIS deletion tombstones & Zero-Trust ACLs opencrawling.org/blog/introdu... #AI #RAG #Search #VectorSearch

000

Piergiorgio Lucidi @pjlucidi.bsky.social · 24/09/2026

Migrating enterprise search crawlers to AI & RAG pipelines shouldn't mean starting from scratch. 🌉 Introducing oc-mcf-migrator in OpenCrawling! 🚀 Convert to OIS YAML, and import Apache ManifoldCF workloads with zero guesswork. opencrawling.org/blog/introdu... #OpenSource #AI #RAG #Search

020

Piergiorgio Lucidi @pjlucidi.bsky.social · 25/08/2026

⚠️ SCAM ALERT! ⚠️ Someone is sending texts from foreign numbers pretending to be me. IT'S NOT ME! 🛑 If you receive one, DO NOT reply, block the number and report it as spam.

000

Piergiorgio Lucidi @pjlucidi.bsky.social · 09/08/2026

Exciting news! Apache ManifoldCF v2.31 has been released. 🎉 This release brings Java 25 support, Virtual Thread processing for high-throughput document indexing, Jetty 12.1. Details & blog post: manifoldcf.apache.org/en_US/blog-m... #EnterpriseSearch #Java25 #OpenSource

030

Piergiorgio Lucidi @pjlucidi.bsky.social · 07/08/2026

🚀 Merged to main: OpenCrawling x Vespa Output Connector! Stream enterprise docs directly into Vespa.ai with HTTP/2 feeding, hybrid vector+BM25 search! ⚡️ Big thanks to Luis Cabaceira for this contribution! 🙌 📖 opencrawling.org/blog/introdu... #OpenCrawling #VespaAI #VectorSearch #AI #OpenSource

020

Piergiorgio Lucidi @pjlucidi.bsky.social · 29/07/2026

Sub-millisecond vector search & payload ACL pre-filtering is LIVE in OpenCrawling! The official Qdrant Output Connector brings high-speed gRPC point streaming, scalar quantization, & zero-leak enterprise RAG to Qdrant collections. 📖 opencrawling.org/blog/introdu... #Qdrant #Java #RAG #OpenSource

010

Reposted by Piergiorgio Lucidi

Apache Software Foundation (The ASF) @apache.org · 28/07/2026

Planning to join Community Over Code Europe 2026 in Glasgow? There's only a few days left to book your stay at discounted hotel rates. The extended hotel discount ends July 31, so be sure to secure your accommodations while the rates are still available. Learn more: buff.ly/UCaQZQ4

buff.ly

Registration

Registration Register Now for Community Over Code Glasgow and/or Lakehouse Day 2026! Early bird conference pricing for this year’s event is US$500, until July 28, when the regular rate of US$…

021

Piergiorgio Lucidi @pjlucidi.bsky.social · 28/07/2026

The official OpenCrawling Java Client SDK (v1.0.0) is LIVE on Maven Central! ☕🎉 Programmatically manage web crawlers, AI ingestion jobs, Copilot templates, & AIOps diagnostics with a fluent Java 25 & Spring Boot 4 client ⚡ opencrawling.org/blog/introdu... #Java #SpringBoot #OpenSource #RAG

130

Piergiorgio Lucidi @pjlucidi.bsky.social · 26/07/2026

Building data connectors shouldn't require writing hundreds of lines of boilerplate 🛠️ Introducing OpenCrawling Maven Archetypes! Scaffold ready-to-build Repository, Output, and Transformation connectors in seconds 🚀 opencrawling.org/blog/introdu... #Maven #Java25 #SpringBoot #OpenSource #RAG #AI

opencrawling.org

Introducing Maven Connector Archetypes: Scaffold Custom Connectors in Seconds

Instantly scaffold standardized Repository, Output, and Transformation connectors for OpenCrawling with Maven Archetypes and Docker Compose overlays.

020

Piergiorgio Lucidi @pjlucidi.bsky.social · 24/07/2026

⚙️ Connect your Flowable & Camunda BPMN engines directly to your AI vector search pipelines! OpenCrawling's new native connectors index process definitions, execution histories, and identity ACLs for Zero-Trust RAG. Read the engineering article 👇 opencrawling.org/blog/introdu... #AI #RAG #BPMN

opencrawling.org

Natively Connecting Flowable & Camunda BPMN Engines to Enterprise RAG

OpenCrawling now natively supports the top open-source BPMN workflow engines: Flowable and Camunda. Stream process definitions, execution histories, and task variables into AI pipelines with full ACL ...

000

Piergiorgio Lucidi @pjlucidi.bsky.social · 23/07/2026

Stop feeding raw JSON to your vector DB 🛑 OpenCrawling’s new Auto-Narrativization Copilot turns structured schemas into human-readable text using Spring AI & Ollama (llama3.2) for vastly better RAG accuracy 🚀 🔗 Read more: opencrawling.org/blog/auto-na... #RAG #DataEngineering #AI #OpenSource

opencrawling.org

Auto-Narrativization Copilot: Bridging Structured Schemas to Vector Embeddings

Learn how OpenCrawling's Auto-Narrativization Copilot translates structured dataset schemas into human-readable Mustache templates using Ollama (llama3.2) and Spring AI.

030

Piergiorgio Lucidi @pjlucidi.bsky.social · 11/07/2026

Agnosticism is in our DNA. OpenCrawling acts as a pluggable, cross-platform bridge: 🔌 Any Repository, 🧠 Any AI Model 🧬 Any Destination Join Our Community! opencrawling.org #OpenStandard #DataFederation #IngestionPipeline #AISecurity #MCP #RAG #VectorSearch

000

Piergiorgio Lucidi @pjlucidi.bsky.social · 06/07/2026

Apache ManifoldCF is taking a massive architectural leap! 🚀 Version 2.31 is officially upgrading to Java 25, Virtual Threads (Project Loom) to deliver high-throughput, low-overhead enterprise crawling. lists.apache.org/list.html?de... #Java #VirtualThreads #OpenSource #InformationRetrieval

041

Piergiorgio Lucidi @pjlucidi.bsky.social · 15/12/2025

Our cover of Gonna Fly Now (Rocky Theme) is now released on music stores!!! Enjoy listening ;) #music #rock #kompoz #distrokid #rocky #guitar #guitarist #guitarplayer #guitarsolo #indiemusic www.piergiorgiolucidi.com/collaboratio...

030