Is `if (idx < arr.length)` equivalent to `if (arr[idx])`?

Assuming that all elements inside an array have a value different from undefined, null or 0, is

if (idx < arr.length) equivalent to if (arr[idx])?