Outliers are an integral part of data. Even though they represent interesting behavior, sometimes it is important to look at the more obvious behavior from the data sets. This would mean adjusting your x and y-axis limits to look at the more relevant data.
Here is a complete tutorial on setting x and y-axis limits in Matplotlib.
