PaddlePaddle 2.6.1: GNN Training Engine, Fake GroupWise Quantization, and Security Patches
Baidu's PaddlePaddle framework has released version 2.6.1, focusing on expanding capabilities for graph neural networks (GNNs) and model efficiency through quantization.
New Capabilities
The release introduces a dedicated graph neural network training engine called PGLBox. According to the vendor, this engine supports the efficient training of ultra-large-scale graph models across multiple GPUs and machines.
Another key addition is support for Fake GroupWise Quantization. This feature is designed to improve model performance and efficiency during the quantization process.
Other improvements include expanded support for custom devices, bfloat16 data types in the `repeat_interleave` operator, and int8 mode inference for the `tile` operator.
Bug Fixes
The update addresses several stability issues. Notable fixes include problems with the Paddle-TRT integration (specifically regarding cache key-value quantization and unit test failures), errors in weight quantization kernels when the size is not divisible by 64, and compilation failures on Windows.
Developers using the framework will also benefit from fixes to the `put_along_axis` operation, including support for `min`, `max`, and `mean` reduction parameters and corrections for gradient calculation bugs.
Security Enhancements
PaddlePaddle 2.6.1 includes patches for multiple security vulnerabilities. The release notes indicate fixes for issues related to drawing functions, decompression, and command execution. Additionally, the framework has implemented stricter memory allocation checks to prevent crashes.