I found that this is related to admin setting:
Use photo view caching to reduce view update queries on high load sites?
Set this to YES if you want to enable the view caching code which caches photo view updates
If I set it to YES, the photo view does not get updated. But if I set it to NO, the photos view gets updated. Could someone please explain it to me? Does it get updated LATER if set to YES?