Newark AP (EWR) is the closest but La Guradia (LGA) and Kennedy (JFK) aren't that far -- maybe 30 miles tops, if that, which in NYC/NJ traffic can take 30 minutes or 2 hours. I'd check prices for flights at all 3 APs. There can be substantial differences. Then factor in the costs of transportation & time; don't forget the tolls.
The outlet malls are pretty good & you can get a decen, clean hotel room at a reasonable price ~~ around $85 per night, or cheaper if you hunt / bid. If it's your first time in the NY metro area you may want to consider splurging & staying in NYC itself but realize that is going to be about $200 per night for a tiny room.