The museum is interesting, but to appreciate it would take an entire day.
You might want to consider visiting Little Italy, Chinatown,Soho and Greenwich Village. They are close together and you can see the entire area easily in one day.
Little Italy has great restaurants if you like Italian food.
An average taxi fare would be no more that $15 each way from Midtown.
Any questions please ask