Discussion:
[Numpy-discussion] Numpy 1.10.3 release.
Charles R Harris
2016-01-02 21:47:51 UTC
Permalink
Hi All,

A significant segfault problem has been reported against Numpy 1.10.2 and I
want to make a quick 1.10.3 release to get it fixed. Two questions


- What exactly is the release process that has been decided on? AFAIK, I
should just do a source release on Sourceforge, ping Matthew to produce
wheels for Mac and wait for him to put them on pypi, and then upload the
sources to pypi. No windows binaries are to be produced.
- Is there anything else that needs fixing for 1.10.3?

Chuck
Matthew Brett
2016-01-02 23:51:14 UTC
Permalink
Hi,

On Sat, Jan 2, 2016 at 9:47 PM, Charles R Harris
Post by Charles R Harris
Hi All,
A significant segfault problem has been reported against Numpy 1.10.2 and I
want to make a quick 1.10.3 release to get it fixed. Two questions
What exactly is the release process that has been decided on? AFAIK, I
should just do a source release on Sourceforge, ping Matthew to produce
wheels for Mac and wait for him to put them on pypi, and then upload the
sources to pypi.
You're welcome to ping me to do the Mac wheels, but I'd be even
happier if you could have a go at triggering the build, to see if you
can make it work:

https://github.com/MacPython/numpy-wheels

Cheers,

Mattthew
Charles R Harris
2016-01-03 00:01:50 UTC
Permalink
Post by Matthew Brett
Hi,
On Sat, Jan 2, 2016 at 9:47 PM, Charles R Harris
Post by Charles R Harris
Hi All,
A significant segfault problem has been reported against Numpy 1.10.2
and I
Post by Charles R Harris
want to make a quick 1.10.3 release to get it fixed. Two questions
What exactly is the release process that has been decided on? AFAIK, I
should just do a source release on Sourceforge, ping Matthew to produce
wheels for Mac and wait for him to put them on pypi, and then upload the
sources to pypi.
You're welcome to ping me to do the Mac wheels, but I'd be even
happier if you could have a go at triggering the build, to see if you
https://github.com/MacPython/numpy-wheels
Hmm... Since it needs to build off the tag to have the correct behavior, I
assume that that needs to be set explicitly. Also, it didn't look as if
your last pypi uploads were signed. Did you upload with twine?

Chuck
Matthew Brett
2016-01-03 00:15:43 UTC
Permalink
On Sun, Jan 3, 2016 at 12:01 AM, Charles R Harris
Post by Charles R Harris
Post by Matthew Brett
Hi,
On Sat, Jan 2, 2016 at 9:47 PM, Charles R Harris
Post by Charles R Harris
Hi All,
A significant segfault problem has been reported against Numpy 1.10.2 and I
want to make a quick 1.10.3 release to get it fixed. Two questions
What exactly is the release process that has been decided on? AFAIK, I
should just do a source release on Sourceforge, ping Matthew to produce
wheels for Mac and wait for him to put them on pypi, and then upload the
sources to pypi.
You're welcome to ping me to do the Mac wheels, but I'd be even
happier if you could have a go at triggering the build, to see if you
https://github.com/MacPython/numpy-wheels
Hmm... Since it needs to build off the tag to have the correct behavior, I
assume that that needs to be set explicitly.
No, the build system uses a script I wrote to find the tag closest in
development history to master, by default - see :
http://stackoverflow.com/a/24557377/1939576

So, if you push a tag, then trigger a build, there's a good chance
that will do what you want. If not, then you can set the tag or
commit explicitly at :

https://github.com/MacPython/numpy-wheels/blob/master/.travis.yml#L5
Post by Charles R Harris
Also, it didn't look as if your
last pypi uploads were signed. Did you upload with twine?
I did yes - with a custom uploader script [1], but I guess it would be
better to download, sign, then upload again using some other mechanism
that preserves the signature.

Cheers,

Matthew

[1] https://github.com/MacPython/terryfy/blob/master/wheel-uploader
j***@gmail.com
2016-01-03 05:05:19 UTC
Permalink
On Sat, Jan 2, 2016 at 4:47 PM, Charles R Harris
Post by Charles R Harris
Hi All,
A significant segfault problem has been reported against Numpy 1.10.2 and I
want to make a quick 1.10.3 release to get it fixed. Two questions
What exactly is the release process that has been decided on? AFAIK, I
should just do a source release on Sourceforge, ping Matthew to produce
wheels for Mac and wait for him to put them on pypi, and then upload the
sources to pypi. No windows binaries are to be produced.
Is there anything else that needs fixing for 1.10.3?
I'm running the 1.10.2 tests on Windows 10 in a virtualbox on Windows 8.1
using Gohlke binary for MKL on a fresh Python 3.5

This test
"Test workarounds for 32-bit limited fwrite, fseek, and ftell ..."
is taking a very long time. Is this expected?


I get the following errors on Windows 10, and also on Windows 8.1
Winpython 3.4 (except for the last "Unable to find vcvarsall.bat"
because it's set up for compiling with mingw)

Earlier I also got a ref count error message but I don't see it
anymore, so maybe I messed up when trying Ctrl+C to kill the tests.


======================================================================
ERROR: Failure: ImportError (cannot import name 'fib2')
----------------------------------------------------------------------
Traceback (most recent call last):
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_ext\tests\test_fib2.py",
line 4, in <module>
from f2py_ext import fib2
ImportError: cannot import name 'fib2'

======================================================================
ERROR: Failure: ImportError (cannot import name 'foo')
----------------------------------------------------------------------
Traceback (most recent call last):
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_f90_ext\tests\test_foo.py",
line 4, in <module>
from f2py_f90_ext import foo
ImportError: cannot import name 'foo'

======================================================================
ERROR: Failure: ImportError (cannot import name 'fib3')
----------------------------------------------------------------------
Traceback (most recent call last):
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\gen_ext\tests\test_fib3.py",
line 3, in <module>
from gen_ext import fib3
ImportError: cannot import name 'fib3'

======================================================================
ERROR: Failure: ImportError (No module named 'pyrex_ext.primes')
----------------------------------------------------------------------
Traceback (most recent call last):
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\pyrex_ext\tests\test_primes.py",
line 4, in <module>
from pyrex_ext.primes import primes
ImportError: No module named 'pyrex_ext.primes'

======================================================================
ERROR: Failure: ImportError (cannot import name 'example')
----------------------------------------------------------------------
Traceback (most recent call last):
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example.py",
line 4, in <module>
from swig_ext import example
ImportError: cannot import name 'example'

======================================================================
ERROR: Failure: ImportError (cannot import name 'example2')
----------------------------------------------------------------------
Traceback (most recent call last):
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example2.py",
line 4, in <module>
from swig_ext import example2
ImportError: cannot import name 'example2'

======================================================================
ERROR: test_compile1 (test_system_info.TestSystemInfoReading)
----------------------------------------------------------------------
Traceback (most recent call last):
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\test_system_info.py",
line 182, in test_compile1
c.compile([os.path.basename(self._src1)], output_dir=self._dir1)
File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 317, in compile
self.initialize()
File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 210, in initialize
vc_env = _get_vc_env(plat_spec)
File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 85, in _get_vc_env
raise DistutilsPlatformError("Unable to find vcvarsall.bat")
distutils.errors.DistutilsPlatformError: Unable to find vcvarsall.bat


Running it again

for Windows 8.1 python 3.4

The above is with `nosetests numpy`
Ran 5232 tests in 134.933s
FAILED (SKIP=40, errors=16)

if I run numpy.test() in the python session, I get
Ran 5191 tests in 22.506s
OK (KNOWNFAIL=10, SKIP=19)


for Windows 10 python 3.5

commandline nostetests numpy
Ran 5615 tests in 423.469s
FAILED (SKIP=33, errors=15)

numpy.test()
Ran 5574 tests in 21.546s
FAILED (KNOWNFAIL=8, SKIP=12, errors=1)
error is only missing vcvarsall.bat


Why is there the large difference in how we run the tests?


Related: The example from #6923 doesn't crash in my settings, neither
python 3.4 nor 3.5.


Josef
Post by Charles R Harris
Chuck
_______________________________________________
NumPy-Discussion mailing list
https://mail.scipy.org/mailman/listinfo/numpy-discussion
j***@gmail.com
2016-01-03 16:54:24 UTC
Permalink
Post by j***@gmail.com
On Sat, Jan 2, 2016 at 4:47 PM, Charles R Harris
Post by Charles R Harris
Hi All,
A significant segfault problem has been reported against Numpy 1.10.2 and I
want to make a quick 1.10.3 release to get it fixed. Two questions
What exactly is the release process that has been decided on? AFAIK, I
should just do a source release on Sourceforge, ping Matthew to produce
wheels for Mac and wait for him to put them on pypi, and then upload the
sources to pypi. No windows binaries are to be produced.
Is there anything else that needs fixing for 1.10.3?
I'm running the 1.10.2 tests on Windows 10 in a virtualbox on Windows 8.1
using Gohlke binary for MKL on a fresh Python 3.5
This test
"Test workarounds for 32-bit limited fwrite, fseek, and ftell ..."
is taking a very long time. Is this expected?
I get the following errors on Windows 10, and also on Windows 8.1
Winpython 3.4 (except for the last "Unable to find vcvarsall.bat"
because it's set up for compiling with mingw)
Earlier I also got a ref count error message but I don't see it
anymore, so maybe I messed up when trying Ctrl+C to kill the tests.
======================================================================
ERROR: Failure: ImportError (cannot import name 'fib2')
----------------------------------------------------------------------
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_ext\tests\test_fib2.py",
line 4, in <module>
from f2py_ext import fib2
ImportError: cannot import name 'fib2'
======================================================================
ERROR: Failure: ImportError (cannot import name 'foo')
----------------------------------------------------------------------
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_f90_ext\tests\test_foo.py",
line 4, in <module>
from f2py_f90_ext import foo
ImportError: cannot import name 'foo'
======================================================================
ERROR: Failure: ImportError (cannot import name 'fib3')
----------------------------------------------------------------------
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\gen_ext\tests\test_fib3.py",
line 3, in <module>
from gen_ext import fib3
ImportError: cannot import name 'fib3'
======================================================================
ERROR: Failure: ImportError (No module named 'pyrex_ext.primes')
----------------------------------------------------------------------
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\pyrex_ext\tests\test_primes.py",
line 4, in <module>
from pyrex_ext.primes import primes
ImportError: No module named 'pyrex_ext.primes'
======================================================================
ERROR: Failure: ImportError (cannot import name 'example')
----------------------------------------------------------------------
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example.py",
line 4, in <module>
from swig_ext import example
ImportError: cannot import name 'example'
======================================================================
ERROR: Failure: ImportError (cannot import name 'example2')
----------------------------------------------------------------------
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example2.py",
line 4, in <module>
from swig_ext import example2
ImportError: cannot import name 'example2'
======================================================================
ERROR: test_compile1 (test_system_info.TestSystemInfoReading)
----------------------------------------------------------------------
File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\test_system_info.py",
line 182, in test_compile1
c.compile([os.path.basename(self._src1)], output_dir=self._dir1)
File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 317, in compile
self.initialize()
File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 210, in initialize
vc_env = _get_vc_env(plat_spec)
File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 85, in _get_vc_env
raise DistutilsPlatformError("Unable to find vcvarsall.bat")
distutils.errors.DistutilsPlatformError: Unable to find vcvarsall.bat
Running it again
for Windows 8.1 python 3.4
The above is with `nosetests numpy`
Ran 5232 tests in 134.933s
FAILED (SKIP=40, errors=16)
if I run numpy.test() in the python session, I get
Ran 5191 tests in 22.506s
OK (KNOWNFAIL=10, SKIP=19)
for Windows 10 python 3.5
commandline nostetests numpy
Ran 5615 tests in 423.469s
FAILED (SKIP=33, errors=15)
numpy.test()
Ran 5574 tests in 21.546s
FAILED (KNOWNFAIL=8, SKIP=12, errors=1)
error is only missing vcvarsall.bat
Why is there the large difference in how we run the tests?
(I'm getting old or forgetting non-stats things.)

default of .test() is skip slow, nosetests doesn't skip

I'm getting the same results also on Winpython 3.4.3.6 on Windows 10.

But python 3.5 install without distribution is not working for me.
I get dll load failed, missing dll, all over the place with the
default PSF install when importing Gohlke scipy.
So, I'm back to winpython and python 3.4


Josef
Post by j***@gmail.com
Related: The example from #6923 doesn't crash in my settings, neither
python 3.4 nor 3.5.
Josef
Post by Charles R Harris
Chuck
_______________________________________________
NumPy-Discussion mailing list
https://mail.scipy.org/mailman/listinfo/numpy-discussion
Charles R Harris
2016-01-04 20:38:42 UTC
Permalink
Post by j***@gmail.com
On Sat, Jan 2, 2016 at 4:47 PM, Charles R Harris
Post by Charles R Harris
Hi All,
A significant segfault problem has been reported against Numpy 1.10.2
and I
Post by Charles R Harris
want to make a quick 1.10.3 release to get it fixed. Two questions
What exactly is the release process that has been decided on? AFAIK, I
should just do a source release on Sourceforge, ping Matthew to produce
wheels for Mac and wait for him to put them on pypi, and then upload the
sources to pypi. No windows binaries are to be produced.
Is there anything else that needs fixing for 1.10.3?
I'm running the 1.10.2 tests on Windows 10 in a virtualbox on Windows 8.1
using Gohlke binary for MKL on a fresh Python 3.5
This test
"Test workarounds for 32-bit limited fwrite, fseek, and ftell ..."
is taking a very long time. Is this expected?
I get the following errors on Windows 10, and also on Windows 8.1
Winpython 3.4 (except for the last "Unable to find vcvarsall.bat"
because it's set up for compiling with mingw)
Earlier I also got a ref count error message but I don't see it
anymore, so maybe I messed up when trying Ctrl+C to kill the tests.
======================================================================
ERROR: Failure: ImportError (cannot import name 'fib2')
----------------------------------------------------------------------
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in
_call_with_frames_removed
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_ext\tests\test_fib2.py",
line 4, in <module>
from f2py_ext import fib2
ImportError: cannot import name 'fib2'
======================================================================
ERROR: Failure: ImportError (cannot import name 'foo')
----------------------------------------------------------------------
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in
_call_with_frames_removed
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_f90_ext\tests\test_foo.py",
line 4, in <module>
from f2py_f90_ext import foo
ImportError: cannot import name 'foo'
======================================================================
ERROR: Failure: ImportError (cannot import name 'fib3')
----------------------------------------------------------------------
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in
_call_with_frames_removed
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\gen_ext\tests\test_fib3.py",
line 3, in <module>
from gen_ext import fib3
ImportError: cannot import name 'fib3'
======================================================================
ERROR: Failure: ImportError (No module named 'pyrex_ext.primes')
----------------------------------------------------------------------
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in
_call_with_frames_removed
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\pyrex_ext\tests\test_primes.py",
line 4, in <module>
from pyrex_ext.primes import primes
ImportError: No module named 'pyrex_ext.primes'
======================================================================
ERROR: Failure: ImportError (cannot import name 'example')
----------------------------------------------------------------------
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in
_call_with_frames_removed
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example.py",
line 4, in <module>
from swig_ext import example
ImportError: cannot import name 'example'
======================================================================
ERROR: Failure: ImportError (cannot import name 'example2')
----------------------------------------------------------------------
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
line 39, in runTest
raise self.exc_val.with_traceback(self.tb)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
line 418, in loadTestsFromName
addr.filename, addr.module)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 234, in load_module
return load_source(name, filename, file)
File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
line 172, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 693, in _load
File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 662, in exec_module
File "<frozen importlib._bootstrap>", line 222, in
_call_with_frames_removed
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example2.py",
line 4, in <module>
from swig_ext import example2
ImportError: cannot import name 'example2'
======================================================================
ERROR: test_compile1 (test_system_info.TestSystemInfoReading)
----------------------------------------------------------------------
File
"c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\test_system_info.py",
line 182, in test_compile1
c.compile([os.path.basename(self._src1)], output_dir=self._dir1)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 317, in compile
self.initialize()
File
"c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 210, in initialize
vc_env = _get_vc_env(plat_spec)
File
"c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
line 85, in _get_vc_env
raise DistutilsPlatformError("Unable to find vcvarsall.bat")
distutils.errors.DistutilsPlatformError: Unable to find vcvarsall.bat
Running it again
for Windows 8.1 python 3.4
The above is with `nosetests numpy`
Ran 5232 tests in 134.933s
FAILED (SKIP=40, errors=16)
if I run numpy.test() in the python session, I get
Ran 5191 tests in 22.506s
OK (KNOWNFAIL=10, SKIP=19)
for Windows 10 python 3.5
commandline nostetests numpy
Ran 5615 tests in 423.469s
FAILED (SKIP=33, errors=15)
numpy.test()
Ran 5574 tests in 21.546s
FAILED (KNOWNFAIL=8, SKIP=12, errors=1)
error is only missing vcvarsall.bat
Why is there the large difference in how we run the tests?
Related: The example from #6923 doesn't crash in my settings, neither
python 3.4 nor 3.5.
The failed tests require pyrex, fortran, and swig. The refcount error comes
and goes, probably the test isn't very good. Ralf, is there any reason to
keep the various extension building tests? They are very old.

I don't know what the recommendation on using nosetests is, but probably it
is finding too many tests.

Chuck
Ralf Gommers
2016-01-06 07:30:52 UTC
Permalink
Post by Charles R Harris
The failed tests require pyrex, fortran, and swig. The refcount error
comes and goes, probably the test isn't very good. Ralf, is there any
reason to keep the various extension building tests? They are very old.
There are f2py tests that are useful - if they fail then building anything
else with f2py fails as well. However those are all in f2py/tests/ IRRC,
not in distutils/tests.
Post by Charles R Harris
I don't know what the recommendation on using nosetests is,
Don't use it (it definitely gives test errors due to not having the
knownfailure plugin), use either runtests.py or numpy.test().
Post by Charles R Harris
but probably it is finding too many tests.
It's doing its job here in finding these though. It looks like these tests
need either fixing (the extensions aren't built) or removing. I'll have a
look tonight.

Ralf
Ralf Gommers
2016-01-06 19:54:02 UTC
Permalink
On Mon, Jan 4, 2016 at 9:38 PM, Charles R Harris <
Post by Charles R Harris
The failed tests require pyrex, fortran, and swig. The refcount error
comes and goes, probably the test isn't very good. Ralf, is there any
reason to keep the various extension building tests? They are very old.
There are f2py tests that are useful - if they fail then building anything
else with f2py fails as well. However those are all in f2py/tests/ IRRC,
not in distutils/tests.
Post by Charles R Harris
I don't know what the recommendation on using nosetests is,
Don't use it (it definitely gives test errors due to not having the
knownfailure plugin), use either runtests.py or numpy.test().
Post by Charles R Harris
but probably it is finding too many tests.
It's doing its job here in finding these though. It looks like these tests
need either fixing (the extensions aren't built) or removing. I'll have a
look tonight.
Should be fixed by https://github.com/numpy/numpy/pull/6955

`nosetests numpy` will still give test errors (6 right now), but only due
to not understanding KnownFailureException.

Ralf

Loading...