I attended the 2017 International Conference on Machine Learning (ICML) in Sydney, Australia. ICML is one of the flagship machine learning conferences. Since machine learning is a very applied field, there was a considerable industry presence, including all the big-name tech giants: Google (Brain, DeepMind), Microsoft, Facebook, Amazon, NVidia, etc. Machine learning isn’t my area of expertise, but it was nonetheless interesting for me to step out of my comfort zone and hear about the state of the art in this very popular field. As one might expect, deep learning and reinforcement learning were prominently featured, and there were some very impressive demonstrations. It looks like there is still much work to be done on the theory side of deep learning, however; the next five years should be quite exciting!
At ICML, I presented joint work with Bin Hu and myself on using energy-based methods (dissipativity theory) to understand and interpret why and how iterative algorithms converge. The key idea is that iterative algorithms are dynamical systems. So if we define the appropriate notion of internal energy, we can write a conservation law (as we do in physics). The rate of dissipation of internal energy is then equivalent to the rate of convergence of the algorithm to its fixed point. If you’re interested, you can download my slides, my poster, or the paper itself.
This was my first time visiting Australia and my first time in the Southern hemisphere too! The photo above is a panorama taken from a ferry looking back at Darling Harbour. In the photo, you can see the iconic Sydney Tower Eye, the Sydney Opera House, and the Sydney Harbour Bridge.
I attended the LCCC Focus Period on Large-Scale and Distributed Optimization at Lund University in Sweden during the month of June, 2017. The focus period consisted of a three week stay and a three-day workshop on the topic of large-scale and distributed optimization. Focus Periods are a unique opportunity for researchers to come together, collaborate, and exchange ideas, but without the time constraints of a standard conference.
I did a one-year postdoc at Lund University right after I completed my Ph.D., so it was nice to return to Lund and see all the familiar faces. Lund is also a beautiful place during the summer! I had a wonderful and productive time in Lund. Made new friends, forged new collaborations, and caught up with many of my former colleagues. Since the focus period was hosted by the Department of Automatic Control, it was a unique opportunity for controls and optimization researchers to come together.
During the workshop, I presented my ongoing work on using robust control tools to analyze and synthesize optimization algorithms. The abstracts and slides for all the talks during the workshop (including mine) are available here.
I attended the SIAM Conference on Optimization in Vancouver, Canada. This was a memorable conference for several reasons. First, this conference only happens once every three years. Its the flagship conference for optimization research, and it was also my first time attending a SIAM conference! Finally, as a Canadian, it is always nice to visit my home country. I also have family living in Vancouver so that was a bonus!
At the conference, I presented my work on using robust control for algorithm analysis and optimization. This talk was part of an invited session titled “Robustness and dynamics in optimization”, organized by Ben Recht and Pablo Parrilo. It was a reprise of our successful session at ICCOPT 2016. If you’re interested in seeing my slides, please refer to my ICCOPT slides as the talks were quite similar.
Above, I included a picture of a Nanaimo Bar from the cafe across the street from the conference venue. This is a uniquely Canadian (and delicious) dessert that is very hard to find in the US. It owes its origin to the city of Nanaimo, British Columbia, which is on Vancouver Island (a short ferry ride away from the city of Vancouver).
This workshop brought together optimization researchers from the midwest for a one-day workshop on a variety of topics including matrix completion, nonconvex approaches, and machine learning. Although most of the talks were from academics, there was also a couple talks and posters from researchers at Argonne National Laboratory. There was also a healthy representation of optimization researchers from UW-Madison! It was an excellent workshop — looking forward to the next one!
This was my first time visiting downtown Chicago and, perhaps fittingly, Google took one of my photos, automatically stylized it, and suggested that this might be a nice photo to keep as a reminder of my trip! Machine learning at work! (see photo above)
I attended the Smart Urban Infrastructures Workshop presented by LIDS at MIT. The idea was to bring together researchers and leaders from academia and industry for a series of short talks and panel discussions. The topics covered several types of “urban infrastructures”, including:
- Ride-sharing platforms: optimization, control, scheduling, and management (car sharing, bike sharing).
- Autonomous vehicles: challenges in robotics, coordination, safety, and accountability.
- Privacy and security in the age of the “internet of things”.
- Power grid: integrating uncertain renewable generation.
It was nice to have a mix of voices from both academia and industry in the panel discussions. As an academic, one can easily be isolated from the “real world”, so I appreciate the diversity. For example, we heard from Nicholas Chamandy (head of data science at Lyft) discuss the intricacies of the large-scale optimization problems faced by a data-driven ride-sharing company. We also heard from Andrew Therriault (chief data officer of the city of Boston) discuss the challenges in managing the smart infrastructure of a major US city.
Looking forward to attending more workshops of this sort in the future! Pictured above is the Stata Center at MIT, one of the coolest-looking buildings I’ve ever seen!
Congratulations to my student Akhil Sundararajan for winning the 2017 Gerald Holdridge Teaching Excellence Award! This annual award recognizes top teaching assistants in Electrical and Computer Engineering at UW-Madison.
Akhil received the award at the ECE department’s annual Spring celebration. This year’s celebration coincided with the ECE department’s 125th anniversary, so Bucky Badger made an appearance to present awards! Pictured on the right is Akhil receiving the teaching award from Bucky. Congrats Akhil!
I recently attended the 6th Midwest Workshop on Control and Game Theory hosted by the University of Michigan. The two-day workshop brought together faculty, postdocs, and grad students in the fields of controls, optimization, game theory, and economics. This was my first time visiting Ann Arbor; it’s truly a beautiful city (see photo on the right!).
My talk was about using tools from robust control to analyze the performance of iterative algorithms. It’s one of my favorite topics to talk about and I’m grateful for the opportunity to present my work to such a diverse crowd! My slides are available for download here.
Congratulations to Vijay Subramanian, Dimitra Panagou, Necmiye Ozay, and the other organizers for a stellar workshop. I’m looking forward to the 7th edition of this workshop next year!
I have been collaborating with Mikhail Kats, an applied physicist at UW-Madison. In recent work, we studied metamers, which are colors that appear the same to the human eye but have different electromagnetic spectra. The fact that metamers are indistinguishable is a result of the limitations of human vision. Mathematically, the human eye performs a projection of electromagnetic spectra onto three real numbers (responses from three different types of cone cells). Some animals, for example, have four or more different types of cone cells, which affords them a projection that is less lossy and the the ability to distinguish colors that might be metamers to us.
Specialized filters can be used (e.g. as glasses or contact lenses) to alter the spectra before they hit our eyes. This has the effect of modifying the projection, which can break certain metameric pairs by making them look different or take colors that were once distinct and make them into metamers. In our recent manuscript, we detail a design for glasses that use different filters for each eye. The result is that the net metamer count can be reduced dramatically without causing undue stress to the eyes. My role in this project was to help with mathematical modeling and to find a way to quantify metamers mathematically.
The work is still a preprint at the moment, and if you’re interested it is available on Arxiv. The manuscript was also picked up by the New Scientist and they published a short and accessible article summarizing the work.
I attended the 2016 Conference on Decision and Control in Las Vegas, Nevada. This was one of the biggest CDC’s to date, with over 1,600 registered participants.
There were several highlights in my opinion. First, the Sunday workshops were excellent. I spent most of my time in the workshop on large-scale SDPs (organized by Amir Ali Ahmadi and Georgina Hall). There were also several “birthday” workshops, celebrating Tryphon Georgiou’s 60th birthday, Pramod Khargonekar’s 60th birthday, and Tamer Basar’s 70th birthday. It was difficult to decide which talks to attend!
Also of note, there was a triple-invited session on distributed optimization organized by Angelia Nedich, Giuseppe Notarstefano, and Alex Olshevsky. It appears that the controls community is taking a keen interest in optimization algorithms, particularly in understanding how to distribute their implementation over an underlying graph or network. The talks touched on multi-arm bandits (very appropriate given the conference venue), clustering, accelerated methods, and much more. I’ll be following these areas of research with interest!
This year’s Bode lecture was delivered by Richard Murray and it was perhaps one of the best Bode lectures I have ever attended. Richard is an excellent speaker and his breadth and depth of knowledge across both theory and application areas is unparalleled. One of his main messages was to encourage control theorists to learn more about computer science — particularly formal verification methods. Looks like I have some reading to do!
The photo on the right shows the display above one of the roulette tables in the casino at the conference hotel. Real-time statistics and analytics to feed all your superstitions — I had no idea this was a thing!