Mining git history to follow datasets

The git version control system enables views into the history of a repository, such as names, dates, and commits, that can be useful in tracing the flows.

I am hoping to use it and pretty format in git’s log command to play around with the git clone --bare option to clone a repository without the code or data. At some moment, I may want that, but for now the metadata is fine. As reference, I am currently using: git log --pretty=format:"%h;%an;%at;%s" to read the data. It is still problematic as commas or semi-colons may appear in the message. A tab? One for when I do the mining itself, but grep may be a useful first start.

What I am hoping to do is to explore some of the challenges raised by David Berry in the Stunlaw blog on The Bonfire of the Models. My interest is in tracing changes for the dataset that may open up the histories of datasets for training.

Update: altered it to git log --pretty=format:"%h%x09%an%x09%at%x09%s so that the file is tab separated.


Updating an old Python application

A colleague and I have been discussing updating an application from Python 2 to Python3. It is an open source project but we want to be able to move it to a cloud instance where Docker is not allowed. There’s a long way to go, I suspect, but using a local Docker enabled me to […]


Critiquing the Sonic

I am currently reading PR Carnet World’s interview with Holger Schulze. It covers a wide range of topics, including LLMs and music / sound that is close to my heart. The concept of think listening seems like an interesting response to the increasingly limited forms. It is the considerations of listening in relation to LLMs […]


Shared cores as Twister?

A few years ago, my supervisor sent me a YouTube video of a CPU being explained as a cooking process. It appeared to have the end of result of a cooked meal! I cannot find the link at the moment (if I come across it later, I will link to it), but … I am […]


Sonification, Big Data, and AI

IEEE Spectrum have an interview, How Sound Could Make Sense of Big Data, with Stephen Roddy on sonification. It sensibly touches on using AI to work with the practice. Interesting read.


Work of Art in AI?

I am planting this link as an aide memoire to reflect as there are references that I do not have current access to on updating Walter Benjamin, technology, and art. The Work of Art in the Age of AI by Howard Eiland.


Resisting training for AI

I have just come across Mark Marino’s first post on resistance training for AI that strikes me as useful: Resistance Training: teaching with and against AI (part 1).


Weeknotes

A crazy week. I had a workshop with the Centre for Digital Inquiry and the Centre for Interdisciplinary Methodologies at Warwick about Leviathan’s Ear. The project and YouTube stream are available. I am not a screen god. I began work on identifying the challenges for the App Studies workshop that will need to be written […]


Weeknotes – Plugins and bits

I spent some of this week working on Gephi plugins. After a conversation with a colleague, I started porting the Image Preview plugin to the latest version. I thought of doing this earlier this year, but no direct need. I did use some AI help for some of the Java an the port. Next up […]


Debugging Gephi Plugin Builds

This post is mainly a note to self. I have recently been porting an old Gephi plugin to run on Gephi 0.11.1 that required quite a lot of work, searching, and a little AI augmentation to resolve some issues that were out of my experience. One of the challenges was that the package would occasionally […]