A new release of our image-dataset-converter-all library is now available: 0.0.6. Docker images have been deployed as well.

The most notably changes are:

• using 90% as default quality for JPEG images now as a good compromise between quality and size (PIL uses 75% by default), this can be overridden with environment variable IDC_JPEG_QUALITY

• added methods to idc.api module: jpeg_quality(), array_to_image(...), empty_image(...)

• numpy is limited to <2.0.0 to avoid issues with the imgaug library

Version 0.2.5 of our llm_dataset_converter library was released December 20th.

With the additional release of ldc_gitingest for converting git repositories (local or remote) into pretrain text files, we also made a new release of our llm_dataset_converter_all meta-library. The newest version here is 0.0.4. A new Docker image is available as well.

Long overdue, but finally here: the revamp of our data-mining.co.nz website is now finally done!

With a refreshed look, better navigation and more information than ever.

Docker images for the latest Yolov10 code base are now available.

The code used by the docker images is available from here:

github.com/waikato-datamining/pytorch/tree/master/yolov10

The tags for the images are as follows:

• In-house registry:

  • public.aml-repo.cms.waikato.ac.nz:443/pytorch/pytorch-yolov10:2024-06-23_cuda11.7

  • public.aml-repo.cms.waikato.ac.nz:443/pytorch/pytorch-yolov5:2022-11-05_cpu

• Docker hub:

  • waikatodatamining/pytorch-yolov10:2024-06-23_cuda11.7

  • waikatodatamining/pytorch-yolov5:2022-11-05_cpu

The tutorial on object detection is available from here:

www.data-mining.co.nz/applied-deep-learning/object_detection/yolov10/

Today marks the first public release of our audio-dataset-converter library and it various additional dependent libraries. Just like image-dataset-converter, it has its origins in the wai.annotations library.

Of course, there is also a meta-library that combines all the libraries: audio-dataset-converter-all

Check out the examples site:

https://waikato-llm.github.io/audio-dataset-converter-examples/