PNG file

In which theme?

The responsive theme has CSS declarations where it styles images with white backgrounds.

Are you familiar with CSS?

Do you have a section in the dashboard named, “Custom CSS”, “Custom CSS Manager” or “Edit CSS”?

In that section, enter this:

.attachment-gallery img {
 background: transparent;
}