High efficiency systems for distributed AI and ML at Scale