Sign in

Johannes Hoffart

@hoffart.ai
720 followers 850 following 15 posts

CTO, AI at SAP - #foundationmodel #linkedbusinessdata #knowledgegraph #nlp #ai - www.hoffart.ai

PostsRepliesMedia
Johannes Hoffart @hoffart.ai · 05/11/2025
SAP-RPT-1 is here: The foundation model for tabular data. Predict payment delays, ticket severity, churn and more with high accuracy and minimal setup. Try it now: * Playground: rpt.cloud.sap * Get open source: huggingface.co/SAP/sap-rpt-... * Read the paper: arxiv.org/abs/2506.10707
rpt.cloud.sap
SAP-RPT-1 Playground | Try with your own test data or SAP-provided example datasets
SAP-RPT-1 is a relational pretrained foundation model that delivers accurate predictive insights from structured business data. It uses in-context learning, allowing users to provide example records directly in API calls, to generate instant, reliable predictions without any model training.
041
Johannes Hoffart @hoffart.ai · 15/09/2025
A new player enters the arena of Foundation Models on Tabular Data: www.limix.ai - novel methods for pre-training and data generation that look highly relevant. Their evaluation on selected datasets is showing strong performance. Exciting times, looking forward to further in depth comparisons!
limix.ai
LimiX
010
Johannes Hoffart @hoffart.ai · 11/09/2025
At #VLDB2025 London I joined a panel on Neural Relational Data. My Take: LLMs solve some data management tasks, but the next wave is Foundation Models on Relational Data and Semantically Linked Tables. More on this and further trends in #AI and #DataManagement - www.hoffart.ai/vldb-2025-ai...
hoffart.ai
VLDB 2025: AI Meets Enterprise Data Management — The Tabular FM Moment – Johannes Hoffart
040
Johannes Hoffart @hoffart.ai · 01/08/2025
Our team developing Foundation Models on Tables & Linked Business Data is looking for a new Senior Applied Research Scientist! Excited about pushing the frontier in foundation models on tabular data? Want to have business impact and academic visibility? Look no further: jobs.sap.com/job/Walldorf...
jobs.sap.com
Senior/Principal Applied Research Scientist (f/m/d): Foundation Models on Linked Business Data
Senior/Principal Applied Research Scientist (f/m/d): Foundation Models on Linked Business Data
030
Reposted by Johannes Hoffart
Grace Lindsay @neurograce.bsky.social · 20/06/2025
For the past 3 years, I've taught a course on Machine Learning for Climate Change to undergrads. At times, people have asked if the course lectures could be made available online. While I can't offer that, I have decided to start making "5 Minute Papers on AI for the Planet" videos. Hope its useful!
youtube.com
5 Minute Papers on AI for the Planet
AI is more than just chatbots! Learn about how AI can be used to protect biodiversity, fight climate change, and just better understand our planet through 5-minute explainers covering academic papers ...
1020253
Reposted by Johannes Hoffart
eleutherai.bsky.social @eleutherai.bsky.social · 06/06/2025
Can you train a performant language model using only openly licensed text? We are thrilled to announce the Common Pile v0.1, an 8TB dataset of openly licensed and public domain text. We train 7B models for 1T and 2T tokens and match the performance similar models like LLaMA 1 & 2
214660
Reposted by Johannes Hoffart
Simon Willison @simonwillison.net · 15/05/2025
Here's the full workshop handout plus annotated slides from "Building software on top of Large Language Models", a three hour tutorial I presented yesterday at PyCon US #PyConUS simonwillison.net/2025/May/15/...
simonwillison.net
Building software on top of Large Language Models
I presented a three hour workshop at PyCon US yesterday titled Building software on top of Large Language Models. The goal of the workshop was to give participants everything they …
418642
Reposted by Johannes Hoffart
François Fleuret @francois.fleuret.org · 28/04/2025
I asked "on the other platform" what were the most important improvements to the original 2017 transformer. That was quite popular and here is a synthesis of the responses:
420643
Reposted by Johannes Hoffart
Ethan Mollick @emollick.bsky.social · 26/04/2025
This was helpful. Also worth noting that Bluesky remains a very fraught place for AI discussions for a variety of reasons, good & bad, but with the impact of keeping a lot of the most relevant AI news, paper discussions & biggest names on X That might change, but it hasn’t yet. Still posting, tho.
1224117
Reposted by Johannes Hoffart
Simon Willison @simonwillison.net · 21/04/2025
It's been a couple of years since GPT-4 powered Bing, but with the various Deep Research products and now o3/o4-mini I'm ready to say that AI assisted search-based research actually works now simonwillison.net/2025/Apr/21/...
simonwillison.net
AI assisted search-based research actually works now
For the past two and a half years the feature I’ve most wanted from LLMs is the ability to take on search-based research tasks on my behalf. We saw the …
69019
Johannes Hoffart @hoffart.ai · 31/03/2025
Very long time ago, ACM SIGMOD 2012. Submitted my thesis outline and got very good feedback both during the session and afterwards during an individual lunch with a very senior colleague. Would recommend!
000
Reposted by Johannes Hoffart
Sebastian Raschka (rasbt) @rasbt.bsky.social · 08/03/2025
I just shared a new article, "The State of Reasoning Models", where I am exploring 12 new research articles on improving the reasoning capabilities of LLMs (all published after the release of DeepSeek R1): magazine.sebastianraschka.com/p/state-of-l... Happy reading!
magazine.sebastianraschka.com
The State of LLM Reasoning Models
Part 1: Inference-Time Compute Scaling Methods
16114
Reposted by Johannes Hoffart
Thomas Wolf @thomwolf.bsky.social · 06/03/2025
I shared a controversial take the other day at an event and I decided to write it down in a longer format: I’m afraid AI won't give us a "compressed 21st century" Here: thomwolf.io/blog/scienti... It's an extension of this interview discussion from the AI summit: youtu.be/AxBd3G0lFLs?...
1113234
Reposted by Johannes Hoffart
Eunsol Choi @eunsol.bsky.social · 06/03/2025
When using LLM-as-a-judge, practitioners often use greedy decoding to get the most likely judgment. But we found that deriving a score from the judgment distribution (like taking the mean) works better! ❌LLM-as-a-judge with greedy decoding 😎Using the distribution of the judge’s labels
1274
Reposted by Johannes Hoffart
ELLIS @ellis.eu · 13/01/2025
Discover European cities ✈️ while building your career! Check out the ELLIS PhD/Postdoc Program's 2025 Winter & Summer School Schedule! Dive deep into cutting-edge #AI research, learn from top researchers & connect with peers across Europe. Learn more: bit.ly/42iow66 #PhD #machinelearning
1156
Reposted by Johannes Hoffart
Thomas Wolf @thomwolf.bsky.social · 01/01/2025
Our first release of 2025: 𝙨𝙢𝙤𝙡𝙖𝙜𝙚𝙣𝙩𝙨, 𝘁𝗵𝗲 𝘀𝗶𝗺𝗽𝗹𝗲𝘀𝘁 𝗹𝗶𝗯𝗿𝗮𝗿𝘆 𝘁𝗼 𝗯𝘂𝗶𝗹𝗱 𝗮𝗴𝗲𝗻𝘁𝗶𝗰 𝘀𝘆𝘀𝘁𝗲𝗺𝘀! 💥 Main logic in ~1000 LoC 🧑‍💻 Agent writes its actions in code! LLMs are much better at writing code than current standard of writing JSON => higher perf 🌍 Any LLM support (h/t LiteLLM) 🛡️ Secure code exec (h/t E2B)
412318
Johannes Hoffart @hoffart.ai · 14/12/2024
Could not be more proud of our crew! Kudos to @marcospinaci.bsky.social Marek Polewczyk Markus Kohler Sam Thelin @tj-klein.bsky.social Clemens Biehl @margaridacosta15.bsky.social Margarida Costa André Sreš Jonas Kolk - tremendous achievement!
010
Johannes Hoffart @hoffart.ai · 14/12/2024
▶️ Open source, multi-table data set containing millions of sales orders sourced from real, production linked business data: Paper 📜 "SALT: Sales Autocompletion Linked Business Tables Dataset" openreview.net/forum?id=UZb... Data 💻 github.com/SAP-samples/...
openreview.net
SALT: Sales Autocompletion Linked Business Tables Dataset
Foundation models, particularly those that incorporate Transformer architectures, have demonstrated exceptional performance in domains such as natural language processing and image processing....
150
Johannes Hoffart @hoffart.ai · 14/12/2024
▶️ Foundation model trained on tabular data, including open weights and code Paper 📜 "PORTAL: Scalable Tabular Foundation Models via Content-Specific Tokenization" openreview.net/forum?id=TSZ... Model & Weights 💻 github.com/SAP-samples/...
openreview.net
PORTAL: Scalable Tabular Foundation Models via Content-Specific...
Self-supervised learning on tabular data seeks to apply advances from natural language and image domains to the diverse domain of tables. However, current techniques often struggle with integrating...
130
Johannes Hoffart @hoffart.ai · 14/12/2024
Have a look at our work on foundation models on tabular data, published today at #TRL @ #NeurIPS2024: 📜 PORTAL, an open weight and code foundation model trained on tabular data, and 📜 SALT, a real business data set containing millions of sales orders across multiple tables. Further details 👇
191
Reposted by Johannes Hoffart
Simon Willison @simonwillison.net · 11/12/2024
Wrote up my initial impressions of the new Google Gemini 2.0 Flash model - it's really good, and the streaming mode (where you can stream video and audio to it and get audio streamed right back) is pure science-fiction simonwillison.net/2024/Dec/11/...
simonwillison.net
Gemini 2.0 Flash: An outstanding multi-modal LLM with a sci-fi streaming mode
Huge announcment from Google this morning: Introducing Gemini 2.0: our new AI model for the agentic era. There’s a ton of stuff in there (including updates on Project Astra and …
916936
Reposted by Johannes Hoffart
Table Representation Learning research @trl-research.bsky.social · 09/12/2024
The 3rd Table Representation Learning (TRL) workshop at NeurIPS 2024 is approaching soon ✨ Join us Saturday 14 Dec from 8:30AM for an amazing program and discussions about all things neural models + tabular data (table-representation-learning.github.io ). Not in Vancouver? Join online neurips.cc 😎
table-representation-learning.github.io
Table Representation Learning Workshop
TRL Workshop ---
193
Johannes Hoffart @hoffart.ai · 04/12/2024
We are growing the team building the SAP Knowledge Graph and are #hiring AI & Data Scientists, Data Engineers, Knowledge Engineers and Applied Research Scientists in Germany (Berlin, Walldorf) and India (Bangalore): jobs.sap.com/search/?crea... Let's take GenAI to the next level with #KG!
jobs.sap.com
SAP Knowledge Graph - SAP Jobs
Find SAP Knowledge Graph at SAP
061
Reposted by Johannes Hoffart
Davide Paglieri @dpaglieri.bsky.social · 21/11/2024
Tired of saturated benchmarks? Want scope for a significant leap in capabilities? 🔥 Introducing BALROG: a Benchmark for Agentic LLM and VLM Reasoning On Games! BALROG is a challenging benchmark for LLM agentic capabilities, designed to stay relevant for years to come. 1/🧵
49620
Reposted by Johannes Hoffart
Raphaël Troncy @rtroncy.bsky.social · 30/11/2024
Great blog post from @odihq.bsky.social @esimperl.bsky.social on the current development state of #dataspaces in Europe. theodi.org/news-and-eve...
theodi.org
What are data spaces and what do they do?
Learn more about data spaces: what they are, what they do and what’s next.
031
Reposted by Johannes Hoffart
Ivan Rubachev @puhsu.bsky.social · 26/11/2024
Tabular DL and AutoML podcast just dropped. For sure watching this youtu.be/3qpQ-sMRafE
youtu.be
How AutoML Creates New Opportunities for Europe - Frank Hutter // CyberValley Podcast #5
YouTube video by Cyber Valley
1112
Johannes Hoffart @hoffart.ai · 26/11/2024
Let me surface this again now that this place is more lively: Come join us at SAP in the US or Germany for a PhD Summer Internship in 2025 in Foundation Models on Structured Data, Table Representation Learning, LLMs and Knowledge Graphs! #MLInternships
093
Reposted by Johannes Hoffart
Mark Collier @markcollier.me · 24/11/2024
Added some more folks to the Open Source AI Starter Pack: go.bsky.app/N8yVZdW
217922
Reposted by Johannes Hoffart
Gerard de Melo @gdemelo.bsky.social · 21/11/2024
I am chairing the AI@HPI Conference: Responsible AI December 3-4 in Potsdam (Berlin metropolitan area) Discussing AI with regard to bias, elections/society, trustworthiness, copyright, the EU AI Act, and best practices. Registration: hpi.de/en/ai-hpi-co... Please spread the word!
AI@HPI Conference logo
172
Reposted by Johannes Hoffart
ELLIS @ellis.eu · 21/11/2024
Hi 👋 We're glad to be here on @bsky.app and looking forward to engaging in this community. But first, learn a little more about us... #ELLISforEurope #AI #ML #CrossBorderCollab #PhD
313120
Reposted by Johannes Hoffart
Marvin Schmitt @marvin-schmitt.com · 24/11/2024
You can create your own rule-based feed with @skyfeed.app, or run a completely self-hosted feed server if you want to go fully custom. For instance, @serge.belongie.com and I just set up an ML Internship feed that collects posts by a keywords-regex and hashtag-MLinternship bsky.app/profile/did:...
35213
Reposted by Johannes Hoffart
AmsterdamNLP @amsterdamnlp.bsky.social · 10/11/2024
Work in progress -- suggestions for NLP-ers based in the EU/Europe & already on Bluesky very welcome! go.bsky.app/NZDc31B
517220
Johannes Hoffart @hoffart.ai · 20/11/2024
Thanks for the list - if there is a spot, happy to be on it!
010
Reposted by Johannes Hoffart
Laura @lauraruis.bsky.social · 20/11/2024
How do LLMs learn to reason from data? Are they ~retrieving the answers from parametric knowledge🦜? In our new preprint, we look at the pretraining data and find evidence against this: Procedural knowledge in pretraining drives LLM reasoning ⚙️🔢 🧵⬇️
36850139
Johannes Hoffart @hoffart.ai · 20/11/2024
This is interesting, thanks for sharing! Curious what you think of this idea: Artificially generate logical reasoning chains e.g. in first order logic, both in logic notation and natural language (e.g. all humans are mortal, Socrates is a human, hence Socrates is mortal), then pre-train on those?
140
Reposted by Johannes Hoffart
Kimon Fountoulakis @kfountou.bsky.social · 16/11/2024
Here is an initial starter pack list on Machine Learning on Graphs: go.bsky.app/HN2MTzp
go.bsky.app
Machine Learning on Graphs
Join the conversation
183421
Reposted by Johannes Hoffart
ACL 2027 @aclmeeting.bsky.social · 19/11/2024
All the ACL chapters are here now: @aaclmeeting.bsky.social @emnlpmeeting.bsky.social @eaclmeeting.bsky.social @naaclmeeting.bsky.social #NLProc
110737
Reposted by Johannes Hoffart
Table Representation Learning research @trl-research.bsky.social · 18/11/2024
🚀 The 60 Accepted Papers and (tentative) Program for the 3rd Table Representation Learning workshop @NeurIPS '24 are out at: table-representation-learning.github.io! Also, reply or DM @madelonhulsebos.bsky.social if you/others should be added to the TRL researcher starterpack: go.bsky.app/4SNSMRj!
1155
Johannes Hoffart @hoffart.ai · 18/11/2024
👋
010
Reposted by Johannes Hoffart
Maike Osborne @maosbot.bsky.social · 09/11/2024
New here? Interested in AI/ML? Check out these great starter packs! AI: go.bsky.app/SipA7it RL: go.bsky.app/3WPHcHg Women in AI: go.bsky.app/LaGDpqg NLP: go.bsky.app/SngwGeS AI and news: go.bsky.app/5sFqVNS You can also search all starter packs here: blueskydirectory.com/starter-pack...
66557212
Reposted by Johannes Hoffart
Marvin Schmitt @marvin-schmitt.com · 17/11/2024
I created a starter pack of scientists in the European Laboratory for Learning and Intelligent Systems (ELLIS) 🇪🇺 Please ping me and I‘ll add you. go.bsky.app/Cihupkk
467727
Reposted by Johannes Hoffart
Madelon Hulsebos @madelonhulsebos.bsky.social · 18/11/2024
WIP starterpack w researchers on Table Representation Learning (TRL): all things related to representation learning and generative models for e.g. tables, DBs, spreadsheets! I'll curate but DM/reply w handle+some info welcome! Also follow @trl-research.bsky.social for updates 🤗 go.bsky.app/4SNSMRj
go.bsky.app
Table Representation Learning researchers
Join the conversation
8248
Johannes Hoffart @hoffart.ai · 18/11/2024
We are looking for PhD summer interns for 2025 in the area of Foundation Models on Structured Data, Table Rep Learning, LLMs and Knowledge Graphs. If you want to work on groundbreaking research on the richest business data available, please reach out to me or apply here: jobs.sap.com/job/Berlin-P...
jobs.sap.com
PhD Intern (f/m/d) - Business AI Research
PhD Intern (f/m/d) - Business AI Research
1123