MICROSOFT DEEPSPEED

[Class - 9]

Downloadable computer software development tools; downloadable computer software for artificial intelligence processing and deep learning; downloadable computer software development libraries, namely, downloadable electronic data files consisting of software development tools for model development and training; downloadable computer software for implementing a computer programming language, and computer software development tools, for use in the fields of artificial intelligence, deep learning, high performance computing, distributed computing, virtualization and machine learning; downloadable computer software, namely, computer software for general purpose computation, manipulation of collections of data, data transformation, communications, graphics display, acceleration of model development, modelling and testing for use in the fields of artificial intelligence, deep learning, high performance computing, distributed computing, virtualization and machine learning; downloadable computer software and software development tools for use in the fields of high performance computing, distributed computing, distributed training with mixed precision, model and pipeline parallelism, redundancy optimization, memory and bandwidth optimization, computational kernel optimization, sparse attention kernels, communication compression, training optimization, training agnostic check pointing, advanced parameter searching, data loading, performance analysis and debugging, and machine learning.