We will present early results from IBM Power8 systems equipped with NVLink connected NVIDIA P100 GPUs. We will show comparative results with previous NVIDIA GPU generations for a set of synthetic and application benchmarks, highlighting in particular the advances in the memory subsystem of P100. The talk will in particular demonstrate the impact of the new double precision atomic add capabilities, and will discuss some early exploration of the behavior of NVLink between the Power8 CPUs and the P100 GPUs.