A minimal model for acoustic forces on Brownian particles