Using large language models (LLMs) as judges for evaluating model outputs has emerged as an important paradigm for automated evaluation. However, the choice of decoding temperature in LLM-as-a-judge s...

Abstract. When you use a large language model (LLM) in your research, you often need to formulate a prompt to elicit some relevant output from the LLM. This step is challenging since (1) LLMs are know...

This monthly annotated bibliography, compiled in August 2026, presents a selective overview of recent scholarly publications on the relationships between artificial intelligence (AI), metadata, and knowledge organization (KO). It is based on literature searches conducted in databases, repositories, and academic search engines, including Scopus, Web of Science, OpenAlex, arXiv, and Google Scholar, as well as selected library and information science journals and other relevant sources. Each entry includes a brief comment written by the author, and the bibliography concludes with a short reflective summary of the publications covered.

Przywódcy ChRL odkrywają po raz enty stary problem chińskiej polityki przemysłowej, kiedy wszyscy wykonują polecenia zbyt gorliwie, trzeba zacząć ich powstrzymywać. Problem w tym, że w Pekinie mogą to zauważyć zazwyczaj kiedy jest za późno.

Research data for the study on librarian-assigned and predicted year intervals. - fereshtaWestin1/research-data-library-year-intervals

This study examines how automatically generated temporal subject metadata for fiction can be evaluated when time is represented as year intervals. Using 45 Swedish novels with manually assigned chr...

Gerard Postiglione assesses the trajectory of China's higher education system amid competing domestic priorities and global ambitions.

Meet the innovators, leaders, and thinkers reshaping our world through advances in artificial intelligence

Jagiellonian University Repository

YouTube video by Nauka. To Lubię

Cultural heritage metadata is not merely descriptive — it encodes the values, identity, and memory of communities. As large language models (LLMs) are increa...

Tool for bibliographic metadata extraction. Contribute to NatLibFi/BIBRA development by creating an account on GitHub.

YouTube video by Copernicus

This paper calls for a rethinking of metadata literacy in the age of AI. Previous discussions often defined metadata literacy as knowledge of descriptive str...

This dataset contains source materials, annotation results, prompts, Python scripts, and evaluation metrics used in a study of the similarities and differences between the automatic evaluation of subject indexing by ChatGPT (GPT-5.1) and Gemini 3 Pro and the assessments made by human reviewers for Polish-language library and information science articles. Detailed information about the dataset structure and file contents is provided in the README_v1.md file.

The study evaluates LLMs as judges for human subject indexing by comparing their performance against a manually curated gold standard across descriptions of forty Polish library and information sci...

The research system has evolved significantly since OSF launched. COS embraces this as an opportunity to build a more resilient foundation for open research that focuses OSF where it can have the most impact, partners with complementary infrastructure, and creates a long-term model.

Applying the theory of representation, in this paper it is argued that the limitations of AI generated solutions are due to AI’s lack of multifaceted cultura...

This editorial introduces JAMS’s new policy on research data and source code availability. It argues that reproducibility—the ability to obtain the same results from the same data and analyses—is a fu...

This monthly annotated bibliography, compiled in July 2026, presents a selective overview of recent scholarly publications on the relationships between artificial intelligence (AI), metadata, and knowledge organization (KO). It is based on literature searches conducted in databases, repositories, and academic search engines, including Scopus, Web of Science, OpenAlex, arXiv, and Google Scholar, as well as selected library and information science journals and other relevant sources. Each entry includes a brief comment written by the author, and the bibliography concludes with a short reflective summary of the publications covered.

Thematic indexing -- the practice of assigning structured conceptual labels to sections of text -- is essential to scholarly access in large-scale literary and historical editions, yet it remains a la...

Registration for FF2026 is now open to everyone! Secure your place today and join us at FF2026, which will be held in Washington, DC. As spaces are filling up quickly, we encourage you to register as ...

How tech companies, journalists, and policymakers can prevent AI decision-making from going wrong.Our lives are increasingly governed by automated systems