In the research paper, “A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation” Futureforce PhD Intern Akhilesh Gotmare, worked with Research Scientist Nitish Shirish Keskar, Director of Research Caiming…
There’s a lot of conversation these days around deep learning, specifically around its remarkable successes in solving challenging reinforcement learning (RL) problems. That said, deep learning still suffers from the need to engineer…
Imagine having your own personal digital assistant. Not merely the command-oriented smart speakers of today, but rather a more sophisticated assistant that knows your behaviors and can anticipate your next inquiry through data-driven…
This summer, Salesforce Research announced our inaugural deep learning research grant for university researchers and faculty, non-profit organizations, and NGOs. Our goal is to identify and support diverse individuals with innovative ideas to join us in shaping the future of AI.
It has been empirically observed that different local optima, obtained from training deep neural networks don't generalize in the same way for the unseen data sets, even if they achieve the same training loss.
Deep learning has significantly improved state-of-the-art performance for natural language processing tasks like machine translation, summarization, question answering, and text classification.
In the same way that human decisions can be influenced by cognitive biases, decisions made by artificially intelligent systems can be vulnerable to algorithmic biases.
Deep reinforcement learning (deep RL) is a popular and successful family of methods for teaching computers tasks ranging from playing Go and Atari games to controlling industrial robots.
Speech recognition has been successfully depolyed on various smart devices, and is changing the way we interact with them. Traditional phonetic-based recognition approaches require training of separate components such as pronouciation, acoustic and language model.
Learning to answer open-ended questions about images, a task known as visual question answering (VQA), has received much attention over the last several years. VQA has been put forth as a benchmark for complete scene understanding and flexible reasoning, two fundamental goals of AI.