Changelog¶
Python 3.11.11 final¶
Release date: 2024-12-03
Tools/Demos¶
gh-123418: Update GitHub CI workflows to use OpenSSL 3.0.15 and multissltests to use 3.0.15, 3.1.7, and 3.2.3.
Tests¶
Security¶
Library¶
Python 3.11.10 final¶
Release date: 2024-09-07
Windows¶
Security¶
gh-123678: Upgrade libexpat to 2.6.3
gh-121957: Fixed missing audit events around interactive use of Python, now also properly firing for
python -i
, as well as forpython -m asyncio
. The event in question iscpython.run_stdin
.gh-122133: Authenticate the socket connection for the
socket.socketpair()
fallback on platforms whereAF_UNIX
is not available like Windows.Patch by Gregory P. Smith <greg@krypto.org> and Seth Larson <seth@python.org>. Reported by Ellie <el@horse64.org>
gh-121285: Remove backtracking from tarfile header parsing for
hdrcharset
, PAX, and GNU sparse headers.gh-118486:
os.mkdir()
on Windows now accepts mode of0o700
to restrict the new directory to the current user. This fixes CVE-2024-4030 affectingtempfile.mkdtemp()
in scenarios where the base temporary directory is more permissive than the default.gh-116741: Update bundled libexpat to 2.6.2
Library¶
gh-123270: Applied a more surgical fix for malformed payloads in
zipfile.Path
causing infinite loops (gh-122905) without breaking contents using legitimate characters.gh-123067: Fix quadratic complexity in parsing
"
-quoted cookie values with backslashes byhttp.cookies
.gh-122905:
zipfile.Path
objects now sanitize names from the zipfile.gh-121650:
email
headers with embedded newlines are now quoted on output. Thegenerator
will now refuse to serialize (write) headers that are unsafely folded or delimited; seeverify_generated_headers
. (Contributed by Bas Bloemsaat and Petr Viktorin in gh-121650.)gh-119506: Fix
io.TextIOWrapper.write()
method breaks internal buffer when the method is called again during flushing internal buffer.gh-118643: Fix an AttributeError in the
email
module when re-fold a long address list. Also fix more cases of incorrect encoding of the address separator in the address list.gh-113171: Fixed various false positives and false negatives in
ipaddress.IPv4Address.is_private
(see these docs for details)
Also in the corresponding
ipaddress.IPv4Network
andipaddress.IPv6Network
attributes.gh-102988:
email.utils.getaddresses()
andemail.utils.parseaddr()
now return('', '')
2-tuples in more situations where invalid email addresses are encountered instead of potentially inaccurate values. Add optional strict parameter to these two functions: usestrict=False
to get the old behavior, accept malformed inputs.getattr(email.utils, 'supports_strict_parsing', False)
can be use to check if the strict paramater is available. Patch by Thomas Dwyer and Victor Stinner to improve the CVE-2023-27043 fix.gh-67693: Fix
urllib.parse.urlunparse()
andurllib.parse.urlunsplit()
for URIs with path starting with multiple slashes and no authority. Based on patch by Ashwin Ramaswami.
Core and Builtins¶
Python 3.11.9 final¶
Release date: 2024-04-02
Security¶
gh-115398: Allow controlling Expat >=2.6.0 reparse deferral (CVE-2023-52425) by adding five new methods:
gh-115399: Update bundled libexpat to 2.6.0
gh-115243: Fix possible crashes in
collections.deque.index()
when the deque is concurrently modified.gh-114572:
ssl.SSLContext.cert_store_stats()
andssl.SSLContext.get_ca_certs()
now correctly lock access to the certificate store, when thessl.SSLContext
is shared across multiple threads.
Core and Builtins¶
gh-116296: Fix possible refleak in
object.__reduce__()
internal error handling.gh-116034: Fix location of the error on a failed assertion.
gh-115823: Properly calculate error ranges in the parser when raising
SyntaxError
exceptions caused by invalid byte sequences. Patch by Pablo Galindogh-112087: For an empty reverse iterator for list will be reduced to
reversed()
. Patch by Donghee Na.gh-115011: Setters for members with an unsigned integer type now support the same range of valid values for objects that has a
__index__()
method as forint
.gh-96497: Fix incorrect resolution of mangled class variables used in assignment expressions in comprehensions.
Library¶
gh-117310: Fixed an unlikely early & extra
Py_DECREF
triggered crash inssl
when creating a new_ssl._SSLContext
if CPython was built implausibly such that the default cipher list is empty or the SSL library it was linked against reports a failure from its CSSL_CTX_set_cipher_list()
API.gh-117178: Fix regression in lazy loading of self-referential modules, introduced in gh-114781.
gh-117084: Fix
zipfile
extraction for directory entries with the name containing backslashes on Windows.gh-117110: Fix a bug that prevents subclasses of
typing.Any
to be instantiated with arguments. Patch by Chris Fu.gh-90872: On Windows,
subprocess.Popen.wait()
no longer callsWaitForSingleObject()
with a negative timeout: pass0
ms if the timeout is negative. Patch by Victor Stinner.gh-116957: configparser: Don't leave ConfigParser values in an invalid state (stored as a list instead of a str) after an earlier read raised DuplicateSectionError or DuplicateOptionError.
gh-90095: Ignore empty lines and comments in
.pdbrc
gh-116764: Restore support of
None
and other false values inurllib.parse
functionsparse_qs()
andparse_qsl()
. Also, they now raise a TypeError for non-zero integers and non-empty sequences.gh-116811: In
PathFinder.invalidate_caches
, delegate toMetadataPathFinder.invalidate_caches
.gh-116484: Change automatically generated
tkinter.Checkbutton
widget names to avoid collisions with automatically generatedtkinter.ttk.Checkbutton
widget names within the same parent widget.gh-116401: Fix blocking
os.fwalk()
andshutil.rmtree()
on opening named pipe.gh-116143: Fix a race in pydoc
_start_server
, eliminating a window in which_start_server
can return a thread that is "serving" but without adocserver
set.gh-116325:
typing
: raiseSyntaxError
instead ofAttributeError
on forward references as empty strings.gh-90535: Fix support of interval values > 1 in
logging.TimedRotatingFileHandler
forwhen='MIDNIGHT'
andwhen='Wx'
.gh-115978: Disable preadv(), readv(), pwritev(), and writev() on WASI.
Under wasmtime for WASI 0.2, these functions don't pass test_posix (https://github.com/bytecodealliance/wasmtime/issues/7830).
gh-88352: Fix the computation of the next rollover time in the
logging.TimedRotatingFileHandler
handler.computeRollover()
now always returns a timestamp larger than the specified time and works correctly during the DST change.doRollover()
no longer overwrite the already rolled over file, saving from data loss when run at midnight or during repeated time at the DST change.gh-87115: Set
__main__.__spec__
toNone
when running a script withpdb
gh-76511: Fix UnicodeEncodeError in
email.Message.as_string()
that results when a message that claims to be in the ascii character set actually has non-ascii characters. Non-ascii characters are now replaced with the U+FFFD replacement character, like in thereplace
error handler.gh-75988: Fixed
unittest.mock.create_autospec()
to pass the call through to the wrapped object to return the real result.gh-115881: Fix issue where
ast.parse()
would incorrectly flag conditional context managers (such aswith (x() if y else z()): ...
) as invalid syntax iffeature_version=(3, 8)
was passed. This reverts changes to the grammar made as part of gh-94949.gh-115886: Fix silent truncation of the name with an embedded null character in
multiprocessing.shared_memory.SharedMemory
.gh-115809: Improve algorithm for computing which rolled-over log files to delete in
logging.TimedRotatingFileHandler
. It is now reliable for handlers withoutnamer
and with arbitrary deterministicnamer
that leaves the datetime part in the file name unmodified.gh-74668:
urllib.parse
functionsparse_qs()
andparse_qsl()
now support bytes arguments containing raw and percent-encoded non-ASCII data.gh-67044:
csv.writer()
now always quotes or escapes'\r'
and'\n'
, regardless of lineterminator value.gh-115712:
csv.writer()
now quotes empty fields if delimiter is a space and skipinitialspace is true and raises exception if quoting is not possible.gh-115618: Fix improper decreasing the reference count for
None
argument inproperty
methodsgetter()
,setter()
anddeleter()
.gh-115570: A
DeprecationWarning
is no longer omitted on access to the__doc__
attributes of the deprecatedtyping.io
andtyping.re
pseudo-modules.gh-112006: Fix
inspect.unwrap()
for types with the__wrapper__
data descriptor.gh-101293: Support callables with the
__call__()
method and types with__new__()
and__init__()
methods set to class methods, static methods, bound methods, partial functions, and other types of methods and descriptors ininspect.Signature.from_callable()
.gh-115392: Fix a bug in
doctest
where incorrect line numbers would be reported for decorated functions.gh-114563: Fix several
format()
bugs when using the C implementation ofDecimal
: * memory leak in some rare cases when using thez
format option (coerce negative 0) * incorrect output when applying thez
format option to typeF
(fixed-point with capitalNAN
/INF
) * incorrect output when applying the#
format option (alternate form)gh-115197:
urllib.request
no longer resolves the hostname before checking it against the system's proxy bypass list on macOS and Windows.gh-115165: Most exceptions are now ignored when attempting to set the
__orig_class__
attribute on objects returned when callingtyping
generic aliases (including generic aliases created usingtyping.Annotated
). Previously onlyAttributeError
was ignored. Patch by Dave Shawley.gh-115133: Fix tests for
XMLPullParser
with Expat 2.6.0.gh-115059:
io.BufferedRandom.read1()
now flushes the underlying write buffer.gh-79382: Trailing
**
no longer allows to match files and non-existing paths in recursiveglob()
.gh-114763: Protect modules loaded with
importlib.util.LazyLoader
from race conditions when multiple threads try to access attributes before the loading is complete.gh-97959: Fix rendering class methods, bound methods, method and function aliases in
pydoc
. Class methods no longer have "method of builtins.type instance" note. Corresponding notes are now added for class and unbound methods. Method and function aliases now have references to the module or the class where the origin was defined if it differs from the current. Bound methods are now listed in the static methods section. Methods of builtin classes are now supported as well as methods of Python classes.gh-112281: Allow creating union of types for
typing.Annotated
with unhashable metadata.gh-111775: Fix
importlib.resources.simple.ResourceHandle.open()
for text mode, added missedstream
argument.gh-90095: Make .pdbrc and -c work with any valid pdb commands.
gh-107155: Fix incorrect output of
help(x)
wherex
is alambda
function, which has an__annotations__
dictionary attribute with a"return"
key.gh-105866: Fixed
_get_slots
bug which caused error when defining dataclasses with slots and a weakref_slot.gh-60346: Fix ArgumentParser inconsistent with parse_known_args.
gh-100985: Update HTTPSConnection to consistently wrap IPv6 Addresses when using a proxy.
gh-100884: email: fix misfolding of comma in address-lists over multiple lines in combination with unicode encoding.
gh-95782: Fix
io.BufferedReader.tell()
,io.BufferedReader.seek()
,_pyio.BufferedReader.tell()
,io.BufferedRandom.tell()
,io.BufferedRandom.seek()
and_pyio.BufferedRandom.tell()
being able to return negative offsets.gh-96310: Fix a traceback in
argparse
when all options in a mutually exclusive group are suppressed.gh-93205: Fixed a bug in
logging.handlers.TimedRotatingFileHandler
where multiple rotating handler instances pointing to files with the same name but different extensions would conflict and not delete the correct files.bpo-44865: Add missing call to localization function in
argparse
.bpo-43952: Fix
multiprocessing.connection.Listener.accept()
to accept empty bytes as authkey. Not accepting empty bytes as key causes it to hang indefinitely.bpo-42125: linecache: get module name from
__spec__
if available. This allows getting source code for the__main__
module when a custom loader is used.gh-66543: Make
mimetypes.guess_type()
properly parsing of URLs with only a host name, URLs containing fragment or query, and filenames with only a UNC sharepoint on Windows. Based on patch by Dong-hee Na.bpo-33775: Add 'default' and 'version' help text for localization in argparse.
Documentation¶
gh-115399: Document CVE-2023-52425 of Expat <2.6.0 under "XML vulnerabilities".
gh-115233: Fix an example for
LoggerAdapter
in the Logging Cookbook.
Tests¶
gh-83434: Disable JUnit XML output (
--junit-xml=FILE
command line option) in regrtest when hunting for reference leaks (-R
option). Patch by Victor Stinner.gh-117187: Fix XML tests for vanilla Expat <2.6.0.
gh-115979: Update test_importlib so that it passes under WASI SDK 21.
gh-116307: Added import helper
isolated_modules
asCleanImport
does not remove modules imported during the context.gh-115720: Leak tests (
-R
,--huntrleaks
) now show a summary of the number of leaks found in each iteration.gh-115122: Add
--bisect
option to regrtest test runner: run failed tests withtest.bisect_cmd
to identify failing tests. Patch by Victor Stinner.gh-115596: Fix
ProgramPriorityTests
intest_os
permanently changing the process priority.gh-115198: Fix test_check_metadata_deprecate in distutils tests with a newer Docutils.
Build¶
Windows¶
gh-116773: Fix instances of
<_overlapped.Overlapped object at 0xXXX> still has pending operation at deallocation, the process may crash
.gh-91227: Fix the asyncio ProactorEventLoop implementation so that sending a datagram to an address that is not listening does not prevent receiving any more datagrams.
gh-115554: The installer now has more strict rules about updating the Lanceur Python pour Windows. In general, most users only have a single launcher installed and will see no difference. When multiple launchers have been installed, the option to install the launcher is disabled until all but one have been removed. Downgrading the launcher (which was never allowed) is now more obviously blocked.
gh-115543: Lanceur Python pour Windows can now detect Python 3.13 when installed from the Microsoft Store, and will install Python 3.12 by default when
PYLAUNCHER_ALLOW_INSTALL
is set.gh-115009: Update Windows installer to use SQLite 3.45.1.
IDLE¶
gh-88516: On macOS show a proxy icon in the title bar of editor windows to match platform behaviour.
Tools/Demos¶
gh-113516: Don't set
LDSHARED
when building for WASI.
C API¶
gh-117021: Fix integer overflow in
PyLong_AsPid()
on non-Windows 64-bit platforms.
Python 3.11.8 final¶
Release date: 2024-02-06
Security¶
gh-113659: Skip
.pth
files with names starting with a dot or hidden file attribute.
Core and Builtins¶
gh-114887: Changed socket type validation in
create_datagram_endpoint()
to accept all non-stream sockets. This fixes a regression in compatibility with raw sockets.gh-114388: Fix a
RuntimeWarning
emitted when assign an integer-like value that is not an instance ofint
to an attribute that corresponds to a C struct member of type T_UINT and T_ULONG. Fix a doubleRuntimeWarning
emitted when assign a negative integer value to an attribute that corresponds to a C struct member of type T_UINT.gh-89811: Check for a valid
tp_version_tag
before performing bytecode specializations that rely on this value being usable.gh-113602: Fix an error that was causing the parser to try to overwrite existing errors and crashing in the process. Patch by Pablo Galindo
gh-113566: Fix a 3.11-specific crash when the
repr
of aFuture
is requested after the module has already been garbage-collected.gh-106905: Use per AST-parser state rather than global state to track recursion depth within the AST parser to prevent potential race condition due to simultaneous parsing.
The issue primarily showed up in 3.11 by multithreaded users of
ast.parse()
. In 3.12 a change to when garbage collection can be triggered prevented the race condition from occurring.gh-112716: Fix SystemError in the
import
statement and in__reduce__()
methods of builtin types when__builtins__
is not a dict.gh-105967: Workaround a bug in Apple's macOS platform zlib library where
zlib.crc32()
andbinascii.crc32()
could produce incorrect results on multi-gigabyte inputs. Including when usingzipfile
on zips containing large data.gh-94606: Fix UnicodeEncodeError when
email.message.get_payload()
reads a message with a Unicode surrogate character and the message content is not well-formed for surrogateescape encoding. Patch by Sidney Markowitz.
Library¶
gh-114965: Update bundled pip to 24.0
gh-114959:
tarfile
no longer ignores errors when trying to extract a directory on top of a file.gh-109475: Fix support of explicit option value "--" in
argparse
(e.g.--option=--
).gh-110190: Fix ctypes structs with array on Windows ARM64 platform by setting
MAX_STRUCT_SIZE
to 32 in stgdict. Patch by Diego Russogh-113280: Fix a leak of open socket in rare cases when error occurred in
ssl.SSLSocket
creation.gh-77749:
email.policy.EmailPolicy.fold()
now always encodes non-ASCII characters in headers ifutf8
is false.gh-114492: Make the result of
termios.tcgetattr()
reproducible on Alpine Linux. Previously it could leave a random garbage in some fields.gh-75128: Ignore an
OSError
inasyncio.BaseEventLoop.create_server()
when IPv6 is available but the interface cannot actually support it.gh-114257: Dismiss the
FileNotFound
error inctypes.util.find_library()
and just returnNone
on Linux.gh-101438: Avoid reference cycle in ElementTree.iterparse. The iterator returned by
ElementTree.iterparse
may hold on to a file descriptor. The reference cycle prevented prompt clean-up of the file descriptor if the returned iterator was not exhausted.gh-104522:
OSError
raised when run a subprocess now only has filename attribute set to cwd if the error was caused by a failed attempt to change the current directory.gh-109534: Fix a reference leak in
asyncio.selector_events.BaseSelectorEventLoop
when SSL handshakes fail. Patch contributed by Jamie Phan.gh-114077: Fix possible
OverflowError
insocket.socket.sendfile()
when pass count larger than 2 GiB on 32-bit platform.gh-114014: Fixed a bug in
fractions.Fraction
where an invalid string usingd
in the decimals part creates a different error compared to other invalid letters/characters. Patch by Jeremiah Gabriel Pascual.gh-113951: Fix the behavior of
tag_unbind()
methods oftkinter.Text
andtkinter.Canvas
classes with three arguments. Previously,widget.tag_unbind(tag, sequence, funcid)
destroyed the current binding for sequence, leaving sequence unbound, and deleted the funcid command. Now it removes only funcid from the binding for sequence, keeping other commands, and deletes the funcid command. It leaves sequence unbound only if funcid was the last bound command.gh-113877: Fix
tkinter
methodwinfo_pathname()
on 64-bit Windows.gh-113781: Silence unraisable AttributeError when warnings are emitted during Python finalization.
gh-113594: Fix
UnicodeEncodeError
inemail
when re-fold lines that contain unknown-8bit encoded part followed by non-unknown-8bit encoded part.gh-113538: In
asyncio.StreamReaderProtocol.connection_made()
, there is callback that logs an error if the task wrapping the "connected callback" fails. This callback would itself fail if the task was cancelled. Prevent this by checking whether the task was cancelled first. If so, close the transport but don't log an error.gh-85567: Fix resource warnings for unclosed files in
pickle
andpickletools
command line interfaces.gh-101225: Increase the backlog for
multiprocessing.connection.Listener
objects created bymultiprocessing.manager
andmultiprocessing.resource_sharer
to significantly reduce the risk of getting a connection refused error when creating amultiprocessing.connection.Connection
to them.gh-113543: Make sure that
webbrowser.MacOSXOSAScript
sendswebbrowser.open
audit event.gh-113028: When a second reference to a string appears in the input to
pickle
, and the Python implementation is in use, we are guaranteed that a single copy gets pickled and a single object is shared when reloaded. Previously, in protocol 0, when a string contained certain characters (e.g. newline) it resulted in duplicate objects.gh-113421: Fix multiprocessing logger for
%(filename)s
.gh-113358: Fix rendering tracebacks for exceptions with a broken
__getattr__
.gh-113214: Fix an
AttributeError
during asyncio SSL protocol aborts in SSL-over-SSL scenarios.gh-113246: Update bundled pip to 23.3.2.
gh-113199: Make
http.client.HTTPResponse.read1
andhttp.client.HTTPResponse.readline
close IO after reading all data when content length is known. Patch by Illia Volochii.gh-113188: Fix
shutil.copymode()
andshutil.copystat()
on Windows. Previously they worked differenly if dst is a symbolic link: they modified the permission bits of dst itself rather than the file it points to if follow_symlinks is true or src is not a symbolic link, and did not modify the permission bits if follow_symlinks is false and src is a symbolic link.gh-61648: Detect line numbers of properties in doctests.
gh-112559:
signal.signal()
andsignal.getsignal()
no longer callrepr
on callable handlers.asyncio.run()
andasyncio.Runner.run()
no longer callrepr
on the task results. Patch by Yilei Yang.gh-110190: Fix ctypes structs with array on PPC64LE platform by setting
MAX_STRUCT_SIZE
to 64 in stgdict. Patch by Diego Russo.gh-79429: Ignore FileNotFoundError when remove a temporary directory in the multiprocessing finalizer.
gh-79325: Fix an infinite recursion error in
tempfile.TemporaryDirectory()
cleanup on Windows.gh-110190: Fix ctypes structs with array on Arm platform by setting
MAX_STRUCT_SIZE
to 32 in stgdict. Patch by Diego Russo.gh-81194: Fix a crash in
socket.if_indextoname()
with specific value (UINT_MAX). Fix an integer overflow insocket.if_indextoname()
on 64-bit non-Windows platforms.gh-75666: Fix the behavior of
tkinter
widget'sunbind()
method with two arguments. Previously,widget.unbind(sequence, funcid)
destroyed the current binding for sequence, leaving sequence unbound, and deleted the funcid command. Now it removes only funcid from the binding for sequence, keeping other commands, and deletes the funcid command. It leaves sequence unbound only if funcid was the last bound command.gh-110345: Show the Tcl/Tk patchlevel (rather than version) in
tkinter._test()
.gh-109858: Protect
zipfile
from "quoted-overlap" zipbomb. It now raises BadZipFile when try to read an entry that overlaps with other entry or central directory.gh-38807: Fix race condition in
trace
. Instead of checking if a directory exists and creating it, directly callos.makedirs()
with the kwargexist_ok=True
.gh-75705: Set unixfrom envelope in
mailbox.mbox
andmailbox.MMDF
.gh-105102: Allow
ctypes.Union
to be nested inctypes.Structure
when the system endianness is the opposite of the classes.gh-104282: Fix null pointer dereference in
lzma._decode_filter_properties()
due to improper handling of BCJ filters with properties of zero length. Patch by Radislav Chugunov.gh-102512: When
os.fork()
is called from a foreign thread (aka_DummyThread
), the type of the thread in a child process is changed to_MainThread
. Also changed its name and daemonic status, it can be now joined.gh-91133: Fix a bug in
tempfile.TemporaryDirectory
cleanup, which now no longer dereferences symlinks when working around file system permission errors.bpo-43153: On Windows,
tempfile.TemporaryDirectory
previously masked aPermissionError
withNotADirectoryError
during directory cleanup. It now correctly raisesPermissionError
if errors are not ignored. Patch by Andrei Kulakov and Ken Jin.bpo-35332: The
shutil.rmtree()
function now ignores errors when callingos.close()
when ignore_errors isTrue
, andos.close()
no longer retried after error.bpo-35928:
io.TextIOWrapper
now correctly handles the decoding buffer afterread()
andwrite()
.bpo-26791:
shutil.move()
now moves a symlink into a directory when that directory is the target of the symlink. This provides the same behavior as the mv shell command. The previous behavior raised an exception. Patch by Jeffrey Kintscher.bpo-36959: Fix some error messages for invalid ISO format string combinations in
strptime()
that referred to directives not contained in the format string. Patch by Gordon P. Hemsley.bpo-18060: Fixed a class inheritance issue that can cause segfaults when deriving two or more levels of subclasses from a base class of Structure or Union.
Documentation¶
gh-110746: Improved markup for valid options/values for methods ttk.treeview.column and ttk.treeview.heading, and for Layouts.
gh-95649: Document that the
asyncio
module contains code taken from v0.16.0 of the uvloop project, as well as the required MIT licensing information.
Tests¶
gh-109980: Fix
test_tarfile_vs_tar
intest_shutil
for macOS, where system tar can include more information in the archive thanshutil.make_archive
.gh-112769: The tests now correctly compare zlib version when
zlib.ZLIB_RUNTIME_VERSION
contains non-integer suffixes. For example zlib-ng defines the version as1.3.0.zlib-ng
.gh-105089: Fix
test.test_zipfile.test_core.TestWithDirectory.test_create_directory_with_write
test in AIX by doing a bitwise AND of 0xFFFF on mode , so that it will be in sync withzinfo.external_attr
bpo-40648: Test modes that file can get with chmod() on Windows.
Build¶
gh-101778: Fix build error when there's a dangling symlink in the directory containing
ffi.h
.gh-112305: Fixed the
check-clean-src
step performed on out of tree builds to detect errant$(srcdir)/Python/frozen_modules/*.h
files and recommend appropriate source tree cleanup steps to get a working build again.bpo-11102: The
os.major()
,os.makedev()
, andos.minor()
functions are now available on HP-UX v3.bpo-36351: Do not set ipv6type when cross-compiling.
Windows¶
gh-109991: Update Windows build to use OpenSSL 3.0.13.
gh-111239: Update Windows builds to use zlib v1.3.1.
gh-100107: The
py.exe
launcher will no longer attempt to run the Microsoft Store redirector when launching a script containing a/usr/bin/env
shebanggh-114096: Process privileges that are activated for creating directory junctions are now restored afterwards, avoiding behaviour changes in other parts of the program.
gh-113009:
multiprocessing
: On Windows, fix a race condition inProcess.terminate()
: no longer set thereturncode
attribute to always callWaitForSingleObject()
inProcess.wait()
. Previously, sometimes the process was still running afterTerminateProcess()
even ifGetExitCodeProcess()
is notSTILL_ACTIVE
. Patch by Victor Stinner.gh-87868: Correctly sort and remove duplicate environment variables in
_winapi.CreateProcess()
.bpo-37308: Fix mojibake in
mmap.mmap
when using a non-ASCII tagname argument on Windows.
macOS¶
gh-115009: Update macOS installer to use SQLite 3.45.1.
gh-109991: Update macOS installer to use OpenSSL 3.0.13.
gh-74573: Document that
dbm.ndbm
can silently corrupt DBM files on updates when exceeding undocumented platform limits, and can crash (segmentation fault) when reading such a corrupted file. (FB8919203)gh-65701: The freeze tool doesn't work with framework builds of Python. Document this and bail out early when running the tool with such a build.
gh-102362: Make sure the result of
sysconfig.get_plaform()
includes at least a major and minor versions, even ifMACOSX_DEPLOYMENT_TARGET
is set to only a major version during build to match the format expected by pip.gh-110017: Disable a signal handling stress test on macOS due to a bug in macOS (FB13453490).
gh-109981: Use
/dev/fd
on macOS to determine the number of open files intest.support.os_helper.fd_count
to avoid a crash with "guarded" file descriptors when probing for open files.
IDLE¶
gh-96905: In idlelib code, stop redefining built-ins 'dict' and 'object'.
gh-72284: Improve the lists of features, editor key bindings, and shell key bingings in the IDLE doc.
gh-113903: Fix rare failure of test.test_idle, in test_configdialog.
gh-113729: Fix the "Help -> IDLE Doc" menu bug in 3.11.7 and 3.12.1.
gh-113269: Fix test_editor hang on macOS Catalina.
gh-112898: Fix processing unsaved files when quitting IDLE on macOS.
gh-103820: Revise IDLE bindings so that events from mouse button 4/5 on non-X11 windowing systems (i.e. Win32 and Aqua) are not mistaken for scrolling.
bpo-13586: Enter the selected text when opening the "Replace" dialog.
Tools/Demos¶
gh-109991: Update GitHub CI workflows to use OpenSSL 3.0.13 and multissltests to use 1.1.1w, 3.0.13, 3.1.5, and 3.2.1.
gh-115015: Fix a bug in Argument Clinic that generated incorrect code for methods with no parameters that use the METH_METHOD | METH_FASTCALL | METH_KEYWORDS calling convention. Only the positional parameter count was checked; any keyword argument passed would be silently accepted.
Python 3.11.7 final¶
Release date: 2023-12-04
Core and Builtins¶
gh-112625: Fixes a bug where a bytearray object could be cleared while iterating over an argument in the
bytearray.join()
method that could result in reading memory after it was freed.gh-112388: Fix an error that was causing the parser to try to overwrite tokenizer errors. Patch by pablo Galindo
gh-112387: Fix error positions for decoded strings with backwards tokenize errors. Patch by Pablo Galindo
gh-109181: Speed up
Traceback
object creation by lazily compute the line number. Patch by Pablo Galindogh-102388: Fix a bug where
iso2022_jp_3
andiso2022_jp_2004
codecs read out of boundsgh-111366: Fix an issue in the
codeop
that was causingSyntaxError
exceptions raised in the presence of invalid syntax to not contain precise error messages. Patch by Pablo Galindogh-111380: Fix a bug that was causing
SyntaxWarning
to appear twice when parsing if invalid syntax is encountered later. Patch by Pablo galindogh-88116: Traceback location ranges involving wide unicode characters (like emoji and asian characters) now are properly highlighted. Patch by Batuhan Taskaya and Pablo Galindo.
gh-94438: Fix a regression that prevented jumping across
is None
andis not None
when debugging. Patch by Savannah Ostrowski.gh-110696: Fix incorrect error message for invalid argument unpacking. Patch by Pablo Galindo
gh-110237: Fix missing error checks for calls to
PyList_Append
in_PyEval_MatchClass
.
Library¶
gh-112618: Fix a caching bug relating to
typing.Annotated
.Annotated[str, True]
is no longer identical toAnnotated[str, 1]
.gh-112509: Fix edge cases that could cause a key to be present in both the
__required_keys__
and__optional_keys__
attributes of atyping.TypedDict
. Patch by Jelle Zijlstra.gh-94722: Fix bug where comparison between instances of
DocTest
fails if one of them hasNone
as its lineno.gh-112105: Make
readline.set_completer_delims()
work with libeditgh-111942: Fix SystemError in the TextIOWrapper constructor with non-encodable "errors" argument in non-debug mode.
gh-109538: Issue warning message instead of having
RuntimeError
be displayed when event loop has already been closed atStreamWriter.__del__()
.gh-111942: Fix crashes in
io.TextIOWrapper.reconfigure()
when pass invalid arguments, e.g. non-string encoding.gh-111804: Remove posix.fallocate() under WASI as the underlying posix_fallocate() is not available in WASI preview2.
gh-111841: Fix truncating arguments on an embedded null character in
os.putenv()
andos.unsetenv()
on Windows.gh-111541: Fix
doctest
forSyntaxError
not-builtin subclasses.gh-110894: Call loop exception handler for exceptions in
client_connected_cb
ofasyncio.start_server()
so that applications can handle it. Patch by Kumar Aditya.gh-111531: Fix reference leaks in
bind_class()
andbind_all()
methods oftkinter
widgets.gh-111356: Added
io.text_encoding()
,io.DEFAULT_BUFFER_SIZE
, andio.IncrementalNewlineDecoder
toio.__all__
.gh-68166: Remove mention of not supported "vsapi" element type in
tkinter.ttk.Style.element_create()
. Add tests forelement_create()
and otherttk.Style
methods. Add examples forelement_create()
in the documentation.gh-111251: Fix
_blake2
not checking for errors when initializing.gh-111174: Fix crash in
io.BytesIO.getbuffer()
called repeatedly for empty BytesIO.gh-111187: Postpone removal version for locale.getdefaultlocale() to Python 3.15.
gh-111159: Fix
doctest
output comparison for exceptions with notes.gh-110910: Fix invalid state handling in
asyncio.TaskGroup
andasyncio.Timeout
. They now raise proper RuntimeError if they are improperly used and are left in consistent state after this.gh-111092: Make turtledemo run without default root enabled.
gh-110590: Fix a bug in
_sre.compile()
whereTypeError
would be overwritten byOverflowError
when the code argument was a list of non-ints.gh-65052: Prevent
pdb
from crashing when trying to display undisplayable objectsgh-110519: Deprecation warning about non-integer number in
gettext
now alwais refers to the line in the user code where gettext function or method is used. Previously it could refer to a line ingettext
code.gh-110378:
contextmanager()
andasynccontextmanager()
context managers now close an invalid underlying generator object that yields more then one value.gh-110365: Fix
termios.tcsetattr()
bug that was overwritting existing errors during parsing integers fromterm
list.gh-110196: Add
__reduce__
method toIPv6Address
in order to keepscope_id
gh-109747: Improve errors for unsupported look-behind patterns. Now re.error is raised instead of OverflowError or RuntimeError for too large width of look-behind pattern.
gh-109786: Fix possible reference leaks and crash when re-enter the
__next__()
method ofitertools.pairwise
.gh-108791: Improved error handling in
pdb
command line interface, making it produce more concise error messages.gh-73561: Omit the interface scope from an IPv6 address when used as Host header by
http.client
.gh-86826:
zipinfo
now supports the full range of values in the TZ string determined by RFC 8536 and detects all invalid formats. Both Python and C implementations now raise exceptions of the same type on invalid data.bpo-41422: Fixed memory leaks of
pickle.Pickler
andpickle.Unpickler
involving cyclic references via the internal memo mapping.bpo-40262: The
ssl.SSLSocket.recv_into()
method no longer requires the buffer argument to implement__len__
and supports buffers with arbitrary item size.bpo-35191: Fix unexpected integer truncation in
socket.setblocking()
which caused it to interpret multiples of2**32
asFalse
.
Documentation¶
Tests¶
gh-110367: Make regrtest
--verbose3
option compatible with--huntrleaks -jN
options. The./python -m test -j1 -R 3:3 --verbose3
command now works as expected. Patch by Victor Stinner.gh-111165: Remove no longer used functions
run_unittest()
andrun_doctest()
and classBasicTestRunner
from thetest.support
module.gh-110932: Fix regrtest if the
SOURCE_DATE_EPOCH
environment variable is defined: use the variable value as the random seed. Patch by Victor Stinner.gh-110995: test_gdb: Fix detection of gdb built without Python scripting support. Patch by Victor Stinner.
gh-110918: Test case matching patterns specified by options
--match
,--ignore
,--matchfile
and--ignorefile
are now tested in the order of specification, and the last match determines whether the test case be run or ignored.gh-110647: Fix test_stress_modifying_handlers() of test_signal. Patch by Victor Stinner.
gh-103053: Fix test_tools.test_freeze on FreeBSD: run "make distclean" instead of "make clean" in the copied source directory to remove also the "python" program. Patch by Victor Stinner.
gh-110167: Fix a deadlock in test_socket when server fails with a timeout but the client is still running in its thread. Don't hold a lock to call cleanup functions in doCleanups(). One of the cleanup function waits until the client completes, whereas the client could deadlock if it called addCleanup() in such situation. Patch by Victor Stinner.
gh-110267: Add tests for pickling and copying PyStructSequence objects. Patched by Xuehai Pan.
gh-109974: Fix race conditions in test_threading lock tests. Wait until a condition is met rather than using
time.sleep()
with a hardcoded number of seconds. Patch by Victor Stinner.gh-109972: Split test_gdb.py file into a test_gdb package made of multiple tests, so tests can now be run in parallel. Patch by Victor Stinner.
gh-104736: Fix test_gdb on Python built with LLVM clang 16 on Linux ppc64le (ex: Fedora 38). Search patterns in gdb "bt" command output to detect when gdb fails to retrieve the traceback. For example, skip a test if
Backtrace stopped: frame did not save the PC
is found. Patch by Victor Stinner.gh-108927: Fixed order dependence in running tests in the same process when a test that has submodules (e.g. test_importlib) follows a test that imports its submodule (e.g. test_importlib.util) and precedes a test (e.g. test_unittest or test_compileall) that uses that submodule.
Build¶
Windows¶
macOS¶
gh-110950: Update macOS installer to include an upstream Tcl/Tk fix for the
Secure coding is not enabled for restorable state!
warning encountered in Tkinter on macOS 14 Sonoma.gh-111015: Ensure that IDLE.app and Python Launcher.app are installed with appropriate permissions on macOS builds.
gh-109286: Update macOS installer to use SQLite 3.43.1.
gh-71383: Update macOS installer to include an upstream Tcl/Tk fix for the
ttk::ThemeChanged
error encountered in Tkinter.gh-92603: Update macOS installer to include a fix accepted by upstream Tcl/Tk for a crash encountered after the first
tkinter.Tk()
instance is destroyed.gh-99834: Update macOS installer to Tcl/Tk 8.6.13.
IDLE¶
bpo-35668: Add docstrings to the IDLE debugger module. Fix two bugs: initialize Idb.botframe (should be in Bdb); in Idb.in_rpc_code, check whether prev_frame is None before trying to use it. Greatly expand test_debugger.
C API¶
gh-112438: Fix support of format units "es", "et", "es#", and "et#" in nested tuples in
PyArg_ParseTuple()
-like functions.gh-109521:
PyImport_GetImporter()
now sets RuntimeError if it fails to getsys.path_hooks
orsys.path_importer_cache
or they are not list and dict correspondingly. Previously it could return NULL without setting error in obscure cases, crash or raise SystemError if these attributes have wrong type.
Python 3.11.6 final¶
Release date: 2023-10-02
Core and Builtins¶
gh-109351: Fix crash when compiling an invalid AST involving a named (walrus) expression.
gh-109207: Fix a SystemError in
__repr__
of symtable entry object.gh-109179: Fix bug where the C traceback display drops notes from
SyntaxError
.gh-88943: Improve syntax error for non-ASCII character that follows a numerical literal. It now points on the invalid non-ASCII character, not on the valid numerical literal.
gh-108959: Fix caret placement for error locations for subscript and binary operations that involve non-semantic parentheses and spaces. Patch by Pablo Galindo
gh-108520: Fix
multiprocessing.synchronize.SemLock.__setstate__()
to properly initializemultiprocessing.synchronize.SemLock._is_fork_ctx
. This fixes a regression when passing a SemLock accross nested processes.Rename
multiprocessing.synchronize.SemLock.is_fork_ctx
tomultiprocessing.synchronize.SemLock._is_fork_ctx
to avoid exposing it as public API.
Library¶
gh-110036: On Windows, multiprocessing
Popen.terminate()
now catchsPermissionError
and get the process exit code. If the process is still running, raise again thePermissionError
. Otherwise, the process terminated as expected: store its exit code. Patch by Victor Stinner.gh-110038: Fixed an issue that caused
KqueueSelector.select()
to not return all the ready events in some cases when a file descriptor is registered for both read and write.gh-109631:
re
functions such asre.findall()
,re.split()
,re.search()
andre.sub()
which perform short repeated matches can now be interrupted by user.gh-109593: Avoid deadlocking on a reentrant call to the multiprocessing resource tracker. Such a reentrant call, though unlikely, can happen if a GC pass invokes the finalizer for a multiprocessing object such as SemLock.
gh-109613: Fix
os.stat()
andos.DirEntry.stat()
: check for exceptions. Previously, on Python built in debug mode, these functions could trigger a fatal Python error (and abort the process) when a function succeeded with an exception set. Patch by Victor Stinner.gh-109375: The
pdb
alias
command now prevents registering aliases without arguments.gh-107219: Fix a race condition in
concurrent.futures
. When a process in the process pool was terminated abruptly (while the future was running or pending), close the connection write end. If the call queue is blocked on sending bytes to a worker process, closing the connection write end interrupts the send, so the queue can be closed. Patch by Victor Stinner.gh-50644: Attempts to pickle or create a shallow or deep copy of
codecs
streams now raise a TypeError. Previously, copying failed with a RecursionError, while pickling produced wrong results that eventually caused unpickling to fail with a RecursionError.gh-108987: Fix
_thread.start_new_thread()
race condition. If a thread is created during Python finalization, the newly spawned thread now exits immediately instead of trying to access freed memory and lead to a crash. Patch by Victor Stinner.gh-108843: Fix an issue in
ast.unparse()
when unparsing f-strings containing many quote types.gh-108682: Enum: raise
TypeError
ifsuper().__new__()
is called from a custom__new__
.gh-105829: Fix concurrent.futures.ProcessPoolExecutor deadlock
gh-64662: Fix support for virtual tables in
sqlite3.Connection.iterdump()
. Patch by Aviv Palivoda.gh-107913: Fix possible losses of
errno
andwinerror
values inOSError
exceptions if they were cleared or modified by the cleanup code before creating the exception object.gh-104372: On Linux where
subprocess
can use thevfork()
syscall for faster spawning, prevent the parent process from blocking other threads by dropping the GIL while it waits for the vfork'ed child processexec()
outcome. This prevents spawning a binary from a slow filesystem from blocking the rest of the application.gh-84867:
unittest.TestLoader
no longer loads test cases from exactunittest.TestCase
andunittest.FunctionTestCase
classes.
Documentation¶
Tests¶
gh-110031: Skip test_threading tests using thread+fork if Python is built with Address Sanitizer (ASAN). Patch by Victor Stinner.
gh-110088: Fix test_asyncio timeouts: don't measure the maximum duration, a test should not measure a CI performance. Only measure the minimum duration when a task has a timeout or delay. Add
CLOCK_RES
totest_asyncio.utils
. Patch by Victor Stinner.gh-110033: Fix
test_interprocess_signal()
oftest_signal
. Make sure that thesubprocess.Popen
object is deleted before the test raising an exception in a signal handler. Otherwise,Popen.__del__()
can get the exception which is logged asException ignored in: ...
and the test fails. Patch by Victor Stinner.gh-109594: Fix test_timeout() of test_concurrent_futures.test_wait. Remove the future which may or may not complete depending if it takes longer than the timeout ot not. Keep the second future which does not complete before wait() timeout. Patch by Victor Stinner.
gh-109748: Fix
test_zippath_from_non_installed_posix()
of test_venv: don't copy__pycache__/
sub-directories, because they can be modified by other Python tests running in parallel. Patch by Victor Stinner.gh-103053: Skip test_freeze_simple_script() of test_tools.test_freeze if Python is built with
./configure --enable-optimizations
, which means with Profile Guided Optimization (PGO): it just makes the test too slow. The freeze tool is tested by many other CIs with other (faster) compiler flags. Patch by Victor Stinner.gh-109396: Fix
test_socket.test_hmac_sha1()
in FIPS mode. Use a longer key: FIPS mode requires at least of at least 112 bits. The previous key was only 32 bits. Patch by Victor Stinner.gh-104736: Fix test_gdb on Python built with LLVM clang 16 on Linux ppc64le (ex: Fedora 38). Search patterns in gdb "bt" command output to detect when gdb fails to retrieve the traceback. For example, skip a test if
Backtrace stopped: frame did not save the PC
is found. Patch by Victor Stinner.gh-109237: Fix
test_site.test_underpth_basic()
when the working directory contains at least one non-ASCII character: encode the._pth
file to UTF-8 and enable the UTF-8 Mode to use UTF-8 for the child process stdout. Patch by Victor Stinner.gh-109230: Fix
test_pyexpat.test_exception()
: it can now be run from a directory different than Python source code directory. Before, the test failed in this case. Skip the test if Modules/pyexpat.c source is not available. Skip also the test on Python implementations other than CPython. Patch by Victor Stinner.gh-109015: Fix test_asyncio, test_imaplib and test_socket tests on FreeBSD if the TCP blackhole is enabled (
sysctl net.inet.tcp.blackhole
). Skip the few tests which failed withETIMEDOUT
which such non standard configuration. Currently, the FreeBSD GCP image enables TCP and UDP blackhole (sysctl net.inet.tcp.blackhole=2
andsysctl net.inet.udp.blackhole=1
). Patch by Victor Stinner.gh-91960: Skip
test_gdb
if gdb is unable to retrieve Python frame objects: if a frame is<optimized out>
. When Python is built with "clang -Og", gdb can fail to retrive the frame parameter of_PyEval_EvalFrameDefault()
. In this case, tests likepy_bt()
are likely to fail. Without getting access to Python frames,python-gdb.py
is mostly clueless on retrieving the Python traceback. Moreover,test_gdb
is no longer skipped on macOS if Python is built with Clang. Patch by Victor Stinner.gh-108962: Skip
test_tempfile.test_flags()
ifchflags()
fails with "OSError: [Errno 45] Operation not supported" (ex: on FreeBSD 13). Patch by Victor Stinner.gh-89392: Removed support of
test_main()
function in tests. They now always use normal unittest test runner.gh-108851: Fix
test_tomllib
recursion tests for WASI buildbots: reduce the recursion limit and compute the maximum nested array/dict depending on the current available recursion limit. Patch by Victor Stinner.gh-108851: Add
get_recursion_available()
andget_recursion_depth()
functions to thetest.support
module. Patch by Victor Stinner.gh-108822:
regrtest
now computes statistics on all tests: successes, failures and skipped.test_netrc
,test_pep646_syntax
andtest_xml_etree
now return results in theirtest_main()
function. Patch by Victor Stinner and Alex Waygood.gh-108388: Convert test_concurrent_futures to a package of 7 sub-tests. Patch by Victor Stinner.
gh-108388: Split test_multiprocessing_fork, test_multiprocessing_forkserver and test_multiprocessing_spawn into test packages. Each package is made of 4 sub-tests: processes, threads, manager and misc. It allows running more tests in parallel and so reduce the total test duration. Patch by Victor Stinner.
gh-101634: When running the Python test suite with
-jN
option, if a worker stdout cannot be decoded from the locale encoding report a failed testn so the exitcode is non-zero. Patch by Victor Stinner.gh-100086: The Python test runner (libregrtest) now logs Python build information like "debug" vs "release" build, or LTO and PGO optimizations. Patch by Victor Stinner.
gh-98903: The Python test suite now fails wit exit code 4 if no tests ran. It should help detecting typos in test names and test methods.
gh-95027: On Windows, when the Python test suite is run with the
-jN
option, the ANSI code page is now used as the encoding for the stdout temporary file, rather than using UTF-8 which can lead to decoding errors. Patch by Victor Stinner.gh-93353: regrtest now checks if a test leaks temporary files or directories if run with -jN option. Patch by Victor Stinner.
Build¶
gh-63760: Fix Solaris build: no longer redefine the
gethostname()
function. Solaris defines the function since 2005. Patch by Victor Stinner, original patch by Jakub Kulík.gh-108740: Fix a race condition in
make regen-all
. Thedeepfreeze.c
source and files generated by Argument Clinic are now generated or updated before generating "global objects". Previously, some identifiers may miss depending on the order in which these files were generated. Patch by Victor Stinner.
Windows¶
macOS¶
gh-109991: Update macOS installer to use OpenSSL 3.0.11.
Tools/Demos¶
gh-109991: Update GitHub CI workflows to use OpenSSL 3.0.11 and multissltests to use 1.1.1w, 3.0.11, and 3.1.3.
Python 3.11.5 final¶
Release date: 2023-08-24
Security¶
gh-108310: Fixed an issue where instances of
ssl.SSLSocket
were vulnerable to a bypass of the TLS handshake and included protections (like certificate verification) and treating sent unencrypted data as if it were post-handshake TLS encrypted data. Security issue reported as CVE-2023-40217 by Aapo Oksman. Patch by Gregory P. Smith.
Core and Builtins¶
gh-104432: Fix potential unaligned memory access on C APIs involving returned sequences of
char *
pointers within thegrp
andsocket
modules. These were revealed using a-fsaniziter=alignment
build on ARM macOS. Patch by Christopher Chavez.gh-77377: Ensure that multiprocessing synchronization objects created in a fork context are not sent to a different process created in a spawn context. This changes a segfault into an actionable RuntimeError in the parent process.
gh-106092: Fix a segmentation fault caused by a use-after-free bug in
frame_dealloc
when the trashcan delays the deallocation of aPyFrameObject
.gh-106719: No longer suppress arbitrary errors in the
__annotations__
getter and setter in the type and module types.gh-106723: Propagate
frozen_modules
to multiprocessing spawned process interpreters.gh-105979: Fix crash in
_imp.get_frozen_object()
due to improper exception handling.gh-105840: Fix possible crashes when specializing function calls with too many
__defaults__
.gh-105588: Fix an issue that could result in crashes when compiling malformed
ast
nodes.gh-105375: Fix bugs in the
builtins
module where exceptions could end up being overwritten.gh-105375: Fix bug in the compiler where an exception could end up being overwritten.
gh-105375: Improve error handling in
PyUnicode_BuildEncodingMap()
where an exception could end up being overwritten.gh-105235: Prevent out-of-bounds memory access during
mmap.find()
calls.
Library¶
gh-105736: Harmonized the pure Python version of OrderedDict with the C version. Now, both versions set up their internal state in
__new__
. Formerly, the pure Python version did the set up in__init__
.gh-107963: Fix
multiprocessing.set_forkserver_preload()
to check the given list of modules names. Patch by Donghee Na.gh-106242: Fixes
os.path.normpath()
to handle embedded null characters without truncating the path.gh-107845:
tarfile.data_filter()
now takes the location of symlinks into account when determining their target, so it will no longer reject some valid tarballs withLinkOutsideDestinationError
.gh-107715: Fix
doctest.DocTestFinder.find()
in presence of class names with special characters. Patch by Gertjan van Zwieten.gh-100814: Passing a callable object as an option value to a Tkinter image now raises the expected TclError instead of an AttributeError.
gh-106684: Close
asyncio.StreamWriter
when it is not closed by application leading to memory leaks. Patch by Kumar Aditya.gh-107077: Seems that in some conditions, OpenSSL will return
SSL_ERROR_SYSCALL
instead ofSSL_ERROR_SSL
when a certification verification has failed, but the error parameters will still containERR_LIB_SSL
andSSL_R_CERTIFICATE_VERIFY_FAILED
. We are now detecting this situation and raising the appropiatessl.SSLCertVerificationError
. Patch by Pablo Galindogh-107396: tarfiles; Fixed use before assignment of self.exception for gzip decompression
gh-62519: Make
gettext.pgettext()
search plural definitions when translation is not found.gh-83006: Document behavior of
shutil.disk_usage()
for non-mounted filesystems on Unix.gh-106186: Do not report
MultipartInvariantViolationDefect
defect when theemail.parser.Parser
class is used to parse emails withheadersonly=True
.gh-106831: Fix potential missing
NULL
check ofd2i_SSL_SESSION
result in_ssl.c
.gh-106774: Update the bundled copy of pip to version 23.2.1.
gh-106752: Fixed several bug in zipfile.Path in
name
/suffix
/suffixes
/stem
operations when no filename is present and the Path is not at the root of the zipfile.gh-106530: Revert a change to
colorsys.rgb_to_hls()
that caused division by zero for certain almost-white inputs. Patch by Terry Jan Reedy.gh-106052:
re
module: fix the matching of possessive quantifiers in the case of a subpattern containing backtracking.gh-106510: Improve debug output for atomic groups in regular expressions.
gh-105497: Fix flag mask inversion when unnamed flags exist.
gh-90876: Prevent
multiprocessing.spawn
from failing to import in environments wheresys.executable
isNone
. This regressed in 3.11 with the addition of support for path-like objects in multiprocessing.gh-106350: Detect possible memory allocation failure in the libtommath function
mp_init()
used by the_tkinter
module.gh-102541: Make pydoc.doc catch bad module ImportError when output stream is not None.
gh-106263: Fix crash when calling
repr
with a manually constructed SignalDict object. Patch by Charlie Zhao.gh-105375: Fix a bug in
_Unpickler_SetInputStream()
where an exception could end up being overwritten in case of failure.gh-105375: Fix bugs in
sys
where exceptions could end up being overwritten because of deferred error handling.gh-105605: Harden
pyexpat
error handling during module initialisation to prevent exceptions from possibly being overwritten, and objects from being dereferenced twice.gh-105375: Fix bug in
decimal
where an exception could end up being overwritten.gh-105375: Fix bugs in
_datetime
where exceptions could be overwritten in case of module initialisation failure.gh-105375: Fix bugs in
_ssl
initialisation which could lead to leaked references and overwritten exceptions.gh-105375: Fix a bug in
array.array
where an exception could end up being overwritten.gh-105375: Fix bugs in
_ctypes
where exceptions could end up being overwritten.gh-105375: Fix a bug in the
posix
module where an exception could be overwritten.gh-105375: Fix bugs in
_elementtree
where exceptions could be overwritten.gh-105375: Fix bugs in
zoneinfo
where exceptions could be overwritten.gh-105375: Fix bugs in
errno
where exceptions could be overwritten.gh-105497: Fix flag inversion when alias/mask members exist.
gh-105375: Fix bugs in
pickle
where exceptions could be overwritten.gh-103171: Revert undocumented behaviour change with runtime-checkable protocols decorated with
typing.final()
in Python 3.11. The behaviour change had meant that objects would not be considered instances of these protocols at runtime unless they had a__final__
attribute. Patch by Alex Waygood.gh-105375: Fix a bug in
sqlite3
where an exception could be overwritten in thecollation
callback.gh-105332: Revert pickling method from by-name back to by-value.
gh-104554: Add RTSPS scheme support in urllib.parse
gh-100061: Fix a bug that causes wrong matches for regular expressions with possessive qualifier.
gh-102541: Hide traceback in
help()
prompt, when import failed.gh-99203: Restore following CPython <= 3.10.5 behavior of
shutil.make_archive()
: do not create an empty archive ifroot_dir
is not a directory, and, in that case, raiseFileNotFoundError
orNotADirectoryError
regardless offormat
choice. Beyond the brought-back behavior, the function may now also raise these exceptions indry_run
mode.gh-94777: Fix hanging
multiprocessing
ProcessPoolExecutor
when a child process crashes while data is being written in the call queue.bpo-18319: Ensure
gettext(msg)
retrieve translations even if a plural form exists. In other words:gettext(msg) == ngettext(msg, '', 1)
.
Documentation¶
Tests¶
gh-105776: Fix test_cppext when the C compiler command
-std=c11
option: remove-std=
options from the compiler command. Patch by Victor Stinner.gh-107237:
test_logging
: Fixtest_udp_reconnection()
by increasing the timeout from 100 ms to 5 minutes (LONG_TIMEOUT). Patch by Victor Stinner.gh-101634: When running the Python test suite with
-jN
option, if a worker stdout cannot be decoded from the locale encoding report a failed testn so the exitcode is non-zero. Patch by Victor Stinner.
Build¶
gh-107814: When calling
find_python.bat
with-q
it did not properly silence the output of nuget. That is now fixed.gh-106881: Check for
linux/limits.h
before including it inModules/posixmodule.c
.gh-104692: Include
commoninstall
as a prerequisite forbininstall
This ensures that
commoninstall
is completed beforebininstall
is started when parallel builds are used (make -j install
), and so thepython3
symlink is only installed after all standard library modules are installed.gh-100340: Allows -Wno-int-conversion for wasm-sdk 17 and onwards, thus enables building WASI builds once against the latest sdk.
Windows¶
gh-106242: Fixes
realpath()
to behave consistently when passed a path containing an embedded null character on Windows. In strict mode, it now raisesOSError
instead of the unexpectedValueError
, and in non-strict mode will make the path absolute.gh-106844: Fix integer overflow in
_winapi.LCMapStringEx()
which affectsntpath.normcase()
.gh-99079: Update Windows build to use OpenSSL 3.0.9
gh-105436: Ensure that an empty environment block is terminated by two null characters, as is required by Windows.
macOS¶
Tools/Demos¶
gh-107565: Update multissltests and GitHub CI workflows to use OpenSSL 1.1.1v, 3.0.10, and 3.1.2.
gh-95065: Argument Clinic now supports overriding automatically generated signature by using directive
@text_signature
. See the Argument Clinic docs.gh-106970: Fix bugs in the Argument Clinic
destination <name> clear
command; the destination buffers would never be cleared, and thedestination
directive parser would simply continue to the fault handler after processing the command. Patch by Erlend E. Aasland.
C API¶
gh-107916: C API functions
PyErr_SetFromErrnoWithFilename()
,PyErr_SetExcFromWindowsErrWithFilename()
andPyErr_SetFromWindowsErrWithFilename()
save now the error code before callingPyUnicode_DecodeFSDefault()
.gh-107915: Such C API functions as
PyErr_SetString()
,PyErr_Format()
,PyErr_SetFromErrnoWithFilename()
and many others no longer crash or ignore errors if it failed to format the error message or decode the filename. Instead, they keep a corresponding error.gh-107226:
PyModule_AddObjectRef()
is now only available in the limited API version 3.10 or later.gh-105375: Fix a bug in
PyErr_WarnExplicit()
where an exception could end up being overwritten if the API failed internally.gh-99612: Fix
PyUnicode_DecodeUTF8Stateful()
for ASCII-only data:*consumed
was not set.
Python 3.11.4 final¶
Release date: 2023-06-06
Security¶
gh-103142: The version of OpenSSL used in our binary builds has been upgraded to 1.1.1u to address several CVEs.
gh-99889: Fixed a security in flaw in
uu.decode()
that could allow for directory traversal based on the input if noout_file
was specified.gh-104049: Do not expose the local on-disk location in directory indexes produced by
http.client.SimpleHTTPRequestHandler
.gh-102153:
urllib.parse.urlsplit()
now strips leading C0 control and space characters following the specification for URLs defined by WHATWG in response to CVE-2023-24329. Patch by Illia Volochii.
Core and Builtins¶
gh-105164: Ensure annotations are set up correctly if the only annotation in a block is within a
match
block. Patch by Jelle Zijlstra.gh-104615: Fix wrong ordering of assignments in code like
a, a = x, y
. Contributed by Carl Meyer.gh-104482: Fix three error handling bugs in ast.c's validation of pattern matching statements.
gh-102818: Do not add a frame to the traceback in the
sys.setprofile
andsys.settrace
trampoline functions. This ensures that frames are not duplicated if an exception is raised in the callback function, and ensures that frames are not omitted if a C callback is used and that does not add the frame.gh-104405: Fix an issue where some bytecode instructions could ignore PEP 523 when "inlining" calls.
gh-104018: Disallow the "z" format specifier in %-format of bytes objects.
gh-103971: Fix an issue where incorrect locations numbers could be assigned to code following
case
blocks.gh-102310: Change the error range for invalid bytes literals.
gh-103590: Do not wrap a single exception raised from a
try-except*
construct in anExceptionGroup
.gh-101517: Fix bug in line numbers of instructions emitted for
except*
.gh-103242: Migrate
set_ecdh_curve()
method not to use deprecated OpenSSL APIs. Patch by Donghee Na.gh-102700: Allow built-in modules to be submodules. This allows submodules to be statically linked into a CPython binary.
gh-101857: Fix xattr support detection on Linux systems by widening the check to linux, not just glibc. This fixes support for musl.
gh-99184: Bypass instance attribute access of
__name__
inrepr
ofweakref.ref
.gh-96670: The parser now raises
SyntaxError
when parsing source code containing null bytes. Backported fromaab01e3
. Patch by Pablo Galindobpo-31821: Fix
pause_reading()
to work when called fromconnection_made()
inasyncio
.
Library¶
gh-105080: Fixed inconsistent signature on derived classes for
inspect.signature()
gh-104874: Document the
__name__
and__supertype__
attributes oftyping.NewType
. Patch by Jelle Zijlstra.gh-104340: When an
asyncio
pipe protocol loses its connection due to an error, and the caller doesn't awaitwait_closed()
on the correspondingStreamWriter
, don't log a warning about an exception that was never retrieved. After all, according to theStreamWriter.close()
docs, thewait_closed()
call is optional ("not mandatory").gh-104372: Refactored the
_posixsubprocess
internals to avoid Python C API usage between fork and exec when markingpass_fds=
file descriptors inheritable.gh-75367: Fix data descriptor detection in
inspect.getattr_static()
.gh-104536: Fix a race condition in the internal
multiprocessing.process
cleanup logic that could manifest as an unintendedAttributeError
when callingprocess.close()
.gh-104399: Prepare the
_tkinter
module for building with Tcl 9.0 and future libtommath by replacing usage of deprecated functionsmp_to_unsigned_bin_n()
andmp_unsigned_bin_size()
when necessary.gh-104307:
socket.getnameinfo()
now releases the GIL while contacting the DNS servergh-87695: Fix issue where
pathlib.Path.glob()
raisedOSError
when it encountered a symlink to an overly long path.gh-104265: Prevent possible crash by disallowing instantiation of the
_csv.Reader
and_csv.Writer
types. The regression was introduced in 3.10.0a4 with PR 23224 (bpo-14935). Patch by Radislav Chugunov.gh-104035: Do not ignore user-defined
__getstate__
and__setstate__
methods for slotted frozen dataclasses.gh-103987: In
mmap
, fix several bugs that could lead to access to memory-mapped files after they have been invalidated.gh-103935: Use
io.open_code()
for files to be executed instead of rawopen()
gh-100370: Fix potential
OverflowError
insqlite3.Connection.blobopen()
for 32-bit builds. Patch by Erlend E. Aasland.gh-103848: Add checks to ensure that
[
bracketed]
hosts found byurllib.parse.urlsplit()
are of IPv6 or IPvFuture format.gh-103872: Update the bundled copy of pip to version 23.1.2.
gh-103861: Fix
zipfile.Zipfile
creating invalid zip files whenforce_zip64
was used to add files to them. Patch by Carey Metcalfe.gh-103685: Prepare
tkinter.Menu.index()
for Tk 8.7 so that it does not raiseTclError: expected integer but got ""
when it should returnNone
.gh-81403:
urllib.request.CacheFTPHandler
no longer raisesURLError
if a cached FTP instance is reused. ftplib's endtransfer method calls voidresp to drain the connection to handle FTP instance reuse properly.gh-103578: Fixed a bug where
pdb
crashes when reading source file with different encoding by replacingio.open()
withio.open_code()
. The new method would also call into the hook set byPyFile_SetOpenCodeHook()
.gh-103556: Now creating
inspect.Signature
objects with positional-only parameter with a default followed by a positional-or-keyword parameter without one is impossible.gh-103559: Update the bundled copy of pip to version 23.1.1.
gh-103365: Set default Flag boundary to
STRICT
and fix bitwise operations.gh-103472: Avoid a potential
ResourceWarning
inhttp.client.HTTPConnection
by closing the proxy / tunnel's CONNECT response explicitly.gh-103449: Fix a bug in doc string generation in
dataclasses.dataclass()
.gh-103256: Fixed a bug that caused
hmac
to raise an exception when the requested hash algorithm was not available in OpenSSL despite being available separately as part ofhashlib
itself. It now falls back properly to the built-in. This could happen when, for example, your OpenSSL does not include SHA3 support and you want to computehmac.digest(b'K', b'M', 'sha3_256')
.gh-103225: Fix a bug in
pdb
when displaying line numbers of module-level source code.gh-93910: Remove deprecation of enum
memmber.member
access.gh-102978: Fixes
unittest.mock.patch()
not enforcing function signatures for methods decorated with@classmethod
or@staticmethod
when patch is called withautospec=True
.gh-103204: Fixes
http.server
accepting HTTP requests with HTTP version numbers preceded by '+', or '-', or with digit-separating '_' characters. The length of the version numbers is also constrained.gh-102953: The extraction methods in
tarfile
, andshutil.unpack_archive()
, have a new a filter argument that allows limiting tar features than may be surprising or dangerous, such as creating files outside the destination directory. See Extraction filters for details.gh-101640:
argparse.ArgumentParser
now catches errors when writing messages, such as whensys.stderr
isNone
. Patch by Oleg Iarygin.gh-96522: Fix potential deadlock in pty.spawn()
gh-87474: Fix potential file descriptor leaks in
subprocess.Popen
.
Documentation¶
gh-89455: Add missing documentation for the
max_group_depth
andmax_group_width
parameters and theexceptions
attribute of thetraceback.TracebackException
class.gh-89412: Add missing documentation for the
end_lineno
andend_offset
attributes of thetraceback.TracebackException
class.gh-104943: Remove mentions of old Python versions in
typing.NamedTuple
.gh-67056: Document that the effect of registering or unregistering an
atexit
cleanup function from within a registered cleanup function is undefined.gh-48241: Clarifying documentation about the url parameter to urllib.request.urlopen and urllib.request.Requst needing to be encoded properly.
Tests¶
gh-104494: Update
test_pack_configure_in
andtest_place_configure_in
for changes to error message formatting in Tk 8.7.gh-104461: Run test_configure_screen on X11 only, since the
DISPLAY
environment variable and-screen
option for toplevels are not useful on Tk for Win32 or Aqua.gh-103329: Regression tests for the behaviour of
unittest.mock.PropertyMock
were added.gh-85984: Utilize new "winsize" functions from termios in pty tests.
gh-75729: Fix the
os.spawn*
tests failing on Windows when the working directory or interpreter path contains spaces.
Build¶
gh-90005: Fix a regression in
configure
where we could end up unintentionally linking withlibbsd
.gh-104106: Add gcc fallback of mkfifoat/mknodat for macOS. Patch by Donghee Na.
gh-99069: Extended workaround defining
static_assert
when missing from the libc headers to all clang and gcc builds. In particular, this fixes building on macOS <= 10.10.
Windows¶
gh-105146: Updated the links at the end of the installer to point to Discourse rather than the mailing lists.
gh-104623: Update Windows installer to use SQLite 3.42.0.
gh-102997: Update Windows installer to use SQLite 3.41.2.
gh-88013: Fixed a bug where
TypeError
was raised when callingntpath.realpath()
with a bytes parameter in some cases.
macOS¶
IDLE¶
Python 3.11.3 final¶
Release date: 2023-04-04
Security¶
gh-101727: Updated the OpenSSL version used in Windows and macOS binary release builds to 1.1.1t to address CVE-2023-0286, CVE-2022-4303, and CVE-2022-4303 per the OpenSSL 2023-02-07 security advisory.
gh-101283:
subprocess.Popen
now uses a safer approach to findcmd.exe
when launching withshell=True
. Patch by Eryk Sun, based on a patch by Oleg Iarygin.
Core and Builtins¶
gh-101975: Fixed
stacktop
value on tracing entries to avoid corruption on garbage collection.gh-102701: Fix overflow when creating very large dict.
gh-102416: Do not memoize incorrectly automatically generated loop rules in the parser. Patch by Pablo Galindo.
gh-102356: Fix a bug that caused a crash when deallocating deeply nested filter objects. Patch by Marta Gómez Macías.
gh-102397: Fix segfault from race condition in signal handling during garbage collection. Patch by Kumar Aditya.
gh-102281: Fix potential nullptr dereference and use of uninitialized memory in fileutils. Patch by Max Bachmann.
gh-102126: Fix deadlock at shutdown when clearing thread states if any finalizer tries to acquire the runtime head lock. Patch by Kumar Aditya.
gh-102027: Fix SSE2 and SSE3 detection in
_blake2
internal module. Patch by Max Bachmann.gh-101967: Fix possible segfault in
positional_only_passed_as_keyword
function, when new list created.gh-101765: Fix SystemError / segmentation fault in iter
__reduce__
when internal access ofbuiltins.__dict__
keys mutates the iter object.gh-101696: Invalidate type version tag in
_PyStaticType_Dealloc
for static types, avoiding bug where a false cache hit could crash the interpreter. Patch by Kumar Aditya.
Library¶
gh-102549: Don't ignore exceptions in member type creation.
gh-102947: Improve traceback when
dataclasses.fields()
is called on a non-dataclass. Patch by Alex Waygoodgh-102780: The
asyncio.Timeout
context manager now works reliably even when performing cleanup due to task cancellation. Previously it could raise aCancelledError
instead of anTimeoutError
in such cases.gh-88965: typing: Fix a bug relating to substitution in custom classes generic over a
ParamSpec
. Previously, if theParamSpec
was substituted with a parameters list that itself contained aTypeVar
, theTypeVar
in the parameters list could not be subsequently substituted. This is now fixed.Patch by Nikita Sobolev.
gh-101979: Fix a bug where parentheses in the
metavar
argument toargparse.ArgumentParser.add_argument()
were dropped. Patch by Yeojin Kim.gh-101961: For the binary mode,
fileinput.hookcompressed()
doesn't set theencoding
value even if the value isNone
. Patch by Gihwan Kim.gh-101936: The default value of
fp
becomesio.BytesIO
ifHTTPError
is initialized without a designatedfp
parameter. Patch by Long Vo.gh-102069: Fix
__weakref__
descriptor generation for custom dataclasses.gh-101566: In zipfile, apply fix for extractall on the underlying zipfile after being wrapped in
Path
.gh-101892: Callable iterators no longer raise
SystemError
when the callable object exhausts the iterator but forgets to either return a sentinel value or raiseStopIteration
.gh-97786: Fix potential undefined behaviour in corner cases of floating-point-to-time conversions.
gh-101517: Fixed bug where
bdb
looks up the source line withlinecache
with alineno=None
, which causes it to fail with an unhandled exception.gh-101673: Fix a
pdb
bug wherell
clears the changes to local variables.gh-96931: Fix incorrect results from
ssl.SSLSocket.shared_ciphers()
gh-88233: Correctly preserve "extra" fields in
zipfile
regardless of their ordering relative to a zip64 "extra."gh-96127:
inspect.signature
was raisingTypeError
on call with mock objects. Now it correctly returns(*args, **kwargs)
as infered signature.gh-95495: When built against OpenSSL 3.0, the
ssl
module had a bug where it reported unauthenticated EOFs (i.e. without close_notify) as a clean TLS-level EOF. It now raisesSSLEOFError
, matching the behavior in previous versions of OpenSSL. Theoptions
attribute onSSLContext
also no longer includesOP_IGNORE_UNEXPECTED_EOF
by default. This option may be set to specify the previous OpenSSL 3.0 behavior.gh-94440: Fix a
concurrent.futures.process
bug whereProcessPoolExecutor
shutdown could hang after a future has been quickly submitted and canceled.
Documentation¶
gh-103112: Add docstring to
http.client.HTTPResponse.read()
to fixpydoc
output.gh-85417: Update
cmath
documentation to clarify behaviour on branch cuts.gh-97725: Fix
asyncio.Task.print_stack()
description forfile=None
. Patch by Oleg Iarygin.
Tests¶
gh-102537: Adjust the error handling strategy in
test_zoneinfo.TzPathTest.python_tzpath_context
. Patch by Paul Ganssle.gh-89792:
test_tools
now copies up to 10x less source data to a temporary directory during thefreeze
test by ignoring git metadata and other artifacts. It also limits its python build parallelism based on os.cpu_count instead of hard coding it as 8 cores.gh-101377: Improved test_locale_calendar_formatweekday of calendar.
Build¶
gh-102711: Fix
-Wstrict-prototypes
compiler warnings.
Windows¶
gh-101849: Ensures installer will correctly upgrade existing
py.exe
launcher installs.gh-101763: Updates copy of libffi bundled with Windows installs to 3.4.4.
gh-101759: Update Windows installer to SQLite 3.40.1.
gh-101614: Correctly handle extensions built against debug binaries that reference
python3_d.dll
.
macOS¶
Python 3.11.2 final¶
Release date: 2023-02-07
Core and Builtins¶
gh-92173: Fix the
defs
andkwdefs
arguments toPyEval_EvalCodeEx()
and a reference leak in that function.gh-101400: Fix wrong lineno in exception message on
continue
orbreak
which are not in a loop. Patch by Donghee Na.gh-101372: Fix
is_normalized()
to properly handle the UCD 3.2.0 cases. Patch by Donghee Na.gh-101046: Fix a possible memory leak in the parser when raising
MemoryError
. Patch by Pablo Galindogh-101037: Fix potential memory underallocation issue for instances of
int
subclasses with value zero.gh-100942: Fixed segfault in property.getter/setter/deleter that occurred when a property subclass overrode the
__new__
method to return a non-property instance.gh-100892: Fix race while iterating over thread states in clearing
threading.local
. Patch by Kumar Aditya.gh-100776: Fix misleading default value in
input()
's__text_signature__
.gh-100637: Fix
int.__sizeof__()
calculation to include the 1 element ob_digit array for 0 and False.gh-100649: Update the native_thread_id field of PyThreadState after fork.
gh-100374: Fix incorrect result and delay in
socket.getfqdn()
. Patch by Dominic Socular.gh-99110: Initialize frame->previous in frameobject.c to fix a segmentation fault when accessing frames created by
PyFrame_New()
.gh-100050: Honor existing errors obtained when searching for mismatching parentheses in the tokenizer. Patch by Pablo Galindo
bpo-32782:
ctypes
arrays of length 0 now report a correct itemsize when amemoryview
is constructed from them, rather than always giving a value of 0.
Library¶
gh-101541: [Enum] - fix psuedo-flag creation
gh-101326: Fix regression when passing
None
as second or third argument toFutureIter.throw
.gh-100795: Avoid potential unexpected
freeaddrinfo
call (double free) insocket
when when a libcgetaddrinfo()
implementation leaves garbage in an output pointer when returning an error. Original patch by Sergey G. Brester.gh-101143: Remove unused references to
TimerHandle
inasyncio.base_events.BaseEventLoop._add_callback
.gh-101144: Make
zipfile.Path.open()
andzipfile.Path.read_text()
also acceptencoding
as a positional argument. This was the behavior in Python 3.9 and earlier. 3.10 introduced a regression where supplying it as a positional argument would lead to aTypeError
.gh-101015: Fix
typing.get_type_hints()
on'*tuple[...]'
and*tuple[...]
. It must not drop theUnpack
part.gh-100573: Fix a Windows
asyncio
bug with named pipes where a client doingos.stat()
on the pipe would cause an error in the server that disabled serving future requests.gh-100805: Modify
random.choice()
implementation to once again work with NumPy arrays.gh-90104: Avoid RecursionError on
repr
if a dataclass field definition has a cyclic reference.gh-100750: pass encoding kwarg to subprocess in platform
gh-100689: Fix crash in
pyexpat
by statically allocatingPyExpat_CAPI
capsule.gh-100740: Fix
unittest.mock.Mock
not respecting the spec for attribute names prefixed withassert
.gh-86508: Fix
asyncio.open_connection()
to skip binding to local addresses of different family. Patch by Kumar Aditya.gh-100287: Fix the interaction of
unittest.mock.seal()
withunittest.mock.AsyncMock
.gh-100474:
http.server
now checks that an index page is actually a regular file before trying to serve it. This avoids issues with directories namedindex.html
.gh-100160: Remove any deprecation warnings in
asyncio.get_event_loop()
. They are deferred to Python 3.12.gh-96290: Fix handling of partial and invalid UNC drives in
ntpath.splitdrive()
, and inntpath.normpath()
on non-Windows systems. Paths such as '\server' and '\' are now considered bysplitdrive()
to contain only a drive, and consequently are not modified bynormpath()
on non-Windows systems. The behaviour ofnormpath()
on Windows systems is unaffected, as native OS APIs are used. Patch by Eryk Sun, with contributions by Barney Gale.gh-78878: Fix crash when creating an instance of
_ctypes.CField
.gh-99952: Fix a reference undercounting issue in
ctypes.Structure
withfrom_param()
results larger than a C pointer.gh-100133: Fix regression in
asyncio
where a subprocess would sometimes lose data received from pipe.gh-100098: Fix
tuple
subclasses being cast totuple
when used as enum values.gh-98778: Update
HTTPError
to be initialized properly, even if thefp
isNone
. Patch by Donghee Na.gh-83035: Fix
inspect.getsource()
handling of decorator calls with nested parentheses.gh-99576: Fix
.save()
method forLWPCookieJar
andMozillaCookieJar
: saved file was not truncated on repeated save.gh-99433: Fix
doctest
failure ontypes.MethodWrapperType
in modules.gh-99240: Fix double-free bug in Argument Clinic
str_converter
by extracting memory clean up to a newpost_parsing
section.gh-64490: Fix refcount error when arguments are packed to tuple in Argument Clinic.
gh-85267: Several improvements to
inspect.signature()
's handling of__text_signature
. - Fixes a case whereinspect.signature()
dropped parameters - Fixes a case whereinspect.signature()
raisedtokenize.TokenError
- Allowsinspect.signature()
to understand defaults involving binary operations of constants -inspect.signature()
is documented as only raisingTypeError
orValueError
, but sometimes raisedRuntimeError
. These cases now raiseValueError
- Removed a dead code pathgh-95882: Fix a 3.11 regression in
asynccontextmanager()
, which caused it to propagate exceptions with incorrect tracebacks and fix a 3.11 regression incontextmanager()
, which caused it to propagate exceptions with incorrect tracebacks forStopIteration
.bpo-44817: Ignore WinError 53 (ERROR_BAD_NETPATH), 65 (ERROR_NETWORK_ACCESS_DENIED) and 161 (ERROR_BAD_PATHNAME) when using ntpath.realpath().
bpo-40447: Accept
os.PathLike
(such aspathlib.Path
) in thestripdir
arguments ofcompileall.compile_file()
andcompileall.compile_dir()
.bpo-36880: Fix a reference counting issue when a
ctypes
callback with return typepy_object
returnsNone
, which could cause crashes.
Documentation¶
gh-100616: Document existing
attr
parameter tocurses.window.vline()
function incurses
.gh-100472: Remove claim in documentation that the
stripdir
,prependdir
andlimit_sl_dest
parameters ofcompileall.compile_dir()
andcompileall.compile_file()
could bebytes
.gh-99931: Use sphinxext-opengraph to generate OpenGraph metadata.
Tests¶
Build¶
gh-101522: Allow overriding Windows dependencies versions and paths using MSBuild properties.
Windows¶
gh-101543: Ensure the install path in the registry is only used when the standard library hasn't been located in any other way.
gh-101467: The
py.exe
launcher now correctly filters when only a single runtime is installed. It also correctly handles prefix matches on tags so that-3.1
does not match3.11
, but would still match3.1-32
.gh-101135: Restore ability to launch older 32-bit versions from the
py.exe
launcher when both 32-bit and 64-bit installs of the same version are available.gh-82052: Fixed an issue where writing more than 32K of Unicode output to the console screen in one go can result in mojibake.
gh-100320: Ensures the
PythonPath
registry key from an install is used when launching from a different copy of Python that relies on an existing install to provide a copy of its modules and standard library.gh-100247: Restores support for the
py.exe
launcher finding shebang commands in its configuration file using the full command name.gh-100180: Update Windows installer to OpenSSL 1.1.1s
bpo-43984:
winreg.SetValueEx()
now leaves the target value untouched in the case of conversion errors. Previously,-1
would be written in case of such errors.
macOS¶
gh-100180: Update macOS installer to OpenSSL 1.1.1s
Tools/Demos¶
bpo-45256: Fix a bug that caused an
AttributeError
to be raised inpython-gdb.py
whenpy-locals
is used without a frame.gh-100342: Add missing
NULL
check for possible allocation failure in*args
parsing in Argument Clinic.gh-64490: Argument Clinic varargs bugfixes
Fix out-of-bounds error in
_PyArg_UnpackKeywordsWithVararg()
.Fix incorrect check which allowed more than one varargs in clinic.py.
Fix miscalculation of
noptargs
in generated code.Do not generate
noptargs
when there is a vararg argument and no optional argument.
C API¶
gh-99240: In argument parsing, after deallocating newly allocated memory, reset its pointer to NULL.
Python 3.11.1 final¶
Release date: 2022-12-06
Security¶
gh-100001:
python -m http.server
no longer allows terminal control characters sent within a garbage request to be printed to the stderr server log.This is done by changing the
http.server
BaseHTTPRequestHandler
.log_message
method to replace control characters with a\xHH
hex escape before printing.gh-87604: Avoid publishing list of active per-interpreter audit hooks via the
gc
modulegh-98433: The IDNA codec decoder used on DNS hostnames by
socket
orasyncio
related name resolution functions no longer involves a quadratic algorithm. This prevents a potential CPU denial of service if an out-of-spec excessive length hostname involving bidirectional characters were decoded. Some protocols such asurllib
http3xx
redirects potentially allow for an attacker to supply such a name.gh-98739: Update bundled libexpat to 2.5.0
gh-97612: Fix a shell code injection vulnerability in the
get-remote-certificate.py
example script. The script no longer uses a shell to runopenssl
commands. Issue reported and initial fix by Caleb Shortt. Patch by Victor Stinner.
Core and Builtins¶
gh-99886: Fix a crash when an object which does not have a dictionary frees its instance values.
gh-99891: Fix a bug in the tokenizer that could cause infinite recursion when showing syntax warnings that happen in the first line of the source. Patch by Pablo Galindo
gh-99729: Fix an issue that could cause frames to be visible to Python code as they are being torn down, possibly leading to memory corruption or hard crashes of the interpreter.
gh-99578: Fix a reference bug in
_imp.create_builtin()
after the creation of the first sub-interpreter for modulesbuiltins
andsys
. Patch by Victor Stinner.gh-99581: Fixed a bug that was causing a buffer overflow if the tokenizer copies a line missing the newline caracter from a file that is as long as the available tokenizer buffer. Patch by Pablo galindo
gh-99553: Fix bug where an
ExceptionGroup
subclass can wrap aBaseException
.gh-99370: Fix zip path for venv created from a non-installed python on POSIX platforms.
gh-99298: Fix an issue that could potentially cause incorrect error handling for some bytecode instructions.
gh-99205: Fix an issue that prevented
PyThreadState
andPyInterpreterState
memory from being freed properly.gh-99181: Fix failure in
except*
with unhashable exceptions.gh-99204: Fix calculation of
sys._base_executable
when inside a POSIX virtual environment using copies of the python binary when the base installation does not provide the executable name used by the venv. Calculation will fall back to alternative names ("python<MAJOR>", "python<MAJOR>.<MINOR>").gh-96055: Update
faulthandler
to emit an error message with the proper unexpected signal number. Patch by Donghee Na.gh-99153: Fix location of
SyntaxError
for atry
block with bothexcept
andexcept*
.gh-99103: Fix the error reporting positions of specialized traceback anchors when the source line contains Unicode characters.
gh-98852: Fix subscription of type aliases containing bare generic types or types like
TypeVar
: for exampletuple[A, T][int]
andtuple[TypeVar, T][int]
, whereA
is a generic type, andT
is a type variable.gh-98925: Lower the recursion depth for marshal on WASI to support wasmtime 2.0/main.
gh-98783: Fix multiple crashes in debug mode when
str
subclasses are used instead ofstr
itself.gh-99257: Fix an issue where member descriptors (such as those for
__slots__
) could behave incorrectly or crash instead of raising aTypeError
when accessed via an instance of an invalid type.gh-98374: Suppress ImportError for invalid query for help() command. Patch by Donghee Na.
gh-98415: Fix detection of MAC addresses for
uuid
on certain OSs. Patch by Chaim Sandersgh-92119: Print exception class name instead of its string representation when raising errors from
ctypes
calls.gh-96078:
os.sched_yield()
now release the GIL while calling sched_yield(2). Patch by Donghee Na.gh-93354: Fix an issue that could delay the specialization of
PRECALL
instructions.gh-97943: Bugfix:
PyFunction_GetAnnotations()
should return a borrowed reference. It was returning a new reference.gh-97779: Ensure that all Python frame objects are backed by "complete" frames.
gh-97591: Fixed a missing incref/decref pair in
Exception.__setstate__()
. Patch by Ofey Chan.gh-94526: Fix the Python path configuration used to initialized
sys.path
at Python startup. Paths are no longer encoded to UTF-8/strict to avoid encoding errors if it contains surrogate characters (bytes paths are decoded with the surrogateescape error handler). Patch by Victor Stinner.gh-95921: Fix overly-broad source position information for chained comparisons used as branching conditions.
gh-96387: At Python exit, sometimes a thread holding the GIL can wait forever for a thread (usually a daemon thread) which requested to drop the GIL, whereas the thread already exited. To fix the race condition, the thread which requested the GIL drop now resets its request before exiting. Issue discovered and analyzed by Mingliang ZHAO. Patch by Victor Stinner.
gh-96864: Fix a possible assertion failure, fatal error, or
SystemError
if a line tracing event raises an exception while opcode tracing is enabled.gh-96678: Fix undefined behaviour in C code of null pointer arithmetic.
gh-96754: Make sure that all frame objects created are created from valid interpreter frames. Prevents the possibility of invalid frames in backtraces and signal handlers.
gh-95196: Disable incorrect pickling of the C implemented classmethod descriptors.
gh-96005: On WASI
ENOTCAPABLE
is now mapped toPermissionError
. Theerrno
modules exposes the new error number.getpath.py
now ignoresPermissionError
when it cannot open landmark filespybuilddir.txt
andpyenv.cfg
.gh-93696: Allow
pdb
to locate source for frozen modules in the standard library.bpo-31718: Raise
ValueError
instead ofSystemError
when methods of uninitializedio.IncrementalNewlineDecoder
objects are called. Patch by Oren Milman.bpo-38031: Fix a possible assertion failure in
io.FileIO
when the opener returns an invalid file descriptor.
Library¶
gh-100001: Also escape s in the http.server BaseHTTPRequestHandler.log_message so that it is technically possible to parse the line and reconstruct what the original data was. Without this a xHH is ambiguious as to if it is a hex replacement we put in or the characters r"x" came through in the original request line.
gh-93453:
asyncio.get_event_loop()
now only emits a deprecation warning when a new event loop was created implicitly. It no longer emits a deprecation warning if the current event loop was set.gh-51524: Fix bug when calling trace.CoverageResults with valid infile.
gh-99645: Fix a bug in handling class cleanups in
unittest.TestCase
. NowaddClassCleanup()
uses separate lists for differentTestCase
subclasses, anddoClassCleanups()
only cleans up the particular class.gh-97001: Release the GIL when calling termios APIs to avoid blocking threads.
gh-99341: Fix
ast.increment_lineno()
to also coverast.TypeIgnore
when changing line numbers.gh-99418: Fix bug in
urllib.parse.urlparse()
that causes URL schemes that begin with a digit, a plus sign, or a minus sign to be parsed incorrectly.gh-99382: Check the number of arguments in substitution in user generics containing a
TypeVarTuple
and one or moreTypeVar
.gh-99379: Fix substitution of
ParamSpec
followed byTypeVarTuple
in generic aliases.gh-99344: Fix substitution of
TypeVarTuple
andParamSpec
together in user generics.gh-74044: Fixed bug where
inspect.signature()
reported incorrect arguments for decorated methods.gh-99275: Fix
SystemError
inctypes
when exception was not set during__initsubclass__
.gh-99277: Remove older version of
_SSLProtocolTransport.get_write_buffer_limits
inasyncio.sslproto
gh-99248: fix negative numbers failing in verify()
gh-99155: Fix
statistics.NormalDist
pickle with0
and1
protocols.gh-93464:
enum.auto()
is now correctly activated when combined with other assignment values. E.g.ONE = auto(), 'some text'
will now evaluate as(1, 'some text')
.gh-99134: Update the bundled copy of pip to version 22.3.1.
gh-83004: Clean up refleak on failed module initialisation in
_zoneinfo
gh-83004: Clean up refleaks on failed module initialisation in in
_pickle
gh-83004: Clean up refleak on failed module initialisation in
_io
.gh-98897: Fix memory leak in
math.dist()
when both points don't have the same dimension. Patch by Kumar Aditya.gh-98706: [3.11] Applied changes from importlib_metadata 4.11.4 through 4.13, including compatibility and robustness fixes for
Distribution
objects without_normalized_name
, disallowing invalid inputs toDistribution.from_name
, and refined behaviors inPathDistribution._name_from_stem
andPathDistribution._normalized_name
.gh-98793: Fix argument typechecks in
_overlapped.WSAConnect()
and_overlapped.Overlapped.WSASendTo()
functions.gh-98744: Prevent crashing in
traceback
when retrieving the byte-offset for some source files that contain certain unicode characters.gh-98740: Fix internal error in the
re
module which in very rare circumstances prevented compilation of a regular expression containing a conditional expression without the "else" branch.gh-98703: Fix
asyncio.StreamWriter.drain()
to callprotocol.connection_lost
callback only once on Windows.gh-98624: Add a mutex to unittest.mock.NonCallableMock to protect concurrent access to mock attributes.
gh-89237: Fix hang on Windows in
subprocess.wait_closed()
inasyncio
withProactorEventLoop
. Patch by Kumar Aditya.gh-98458: Fix infinite loop in unittest when a self-referencing chained exception is raised
gh-97928:
tkinter.Text.count()
raises now an exception for options starting with "-" instead of silently ignoring them.gh-97966: On
uname_result
, restored expectation that_fields
and_asdict
would include all six properties includingprocessor
.gh-98307: A
createSocket()
method was added toSysLogHandler
.gh-96035: Fix bug in
urllib.parse.urlparse()
that causes certain port numbers containing whitespace, underscores, plus and minus signs, or non-ASCII digits to be incorrectly accepted.gh-98251: Allow
venv
to pass alongPYTHON*
variables toensurepip
andpip
when they do not impact path resolutiongh-98178: On macOS, fix a crash in
syslog.syslog()
in multi-threaded applications. On macOS, the libcsyslog()
function is not thread-safe, sosyslog.syslog()
no longer releases the GIL to call it. Patch by Victor Stinner.gh-96151: Allow
BUILTINS
to be a valid field name for frozen dataclasses.gh-87730: Wrap network errors consistently in urllib FTP support, so the test suite doesn't fail when a network is available but the public internet is not reachable.
gh-98086: Make sure
patch.dict()
can be applied on async functions.gh-90985: Earlier in 3.11 we deprecated
asyncio.Task.cancel("message")
. We realized we were too harsh, and have undeprecated it.gh-97837: Change deprecate warning message in
unittest
fromIt is deprecated to return a value!=None
to
It is deprecated to return a value that is not None from a test case
gh-97825: Fixes
AttributeError
whensubprocess.check_output()
is used with argumentinput=None
and either of the arguments encoding or errors are used.gh-82836: Fix
is_private
properties in theipaddress
module. Previously non-private networks (0.0.0.0/0) would return True from this method; now they correctly return False.gh-96827: Avoid spurious tracebacks from
asyncio
when default executor cleanup is delayed until after the event loop is closed (e.g. as the result of a keyboard interrupt).gh-97592: Avoid a crash in the C version of
asyncio.Future.remove_done_callback()
when an evil argument is passed.gh-73588: Fix generation of the default name of
tkinter.Checkbutton
. Previously, checkbuttons in different parent widgets could have the same short name and share the same state if arguments "name" and "variable" are not specified. Now they are globally unique.gh-97005: Update bundled libexpat to 2.4.9
gh-85760: Fix race condition in
asyncio
whereprocess_exited()
called before thepipe_data_received()
leading to inconsistent output. Patch by Kumar Aditya.gh-96819: Fixed check in
multiprocessing.resource_tracker
that guarantees that the length of a write to a pipe is not greater thanPIPE_BUF
.gh-96741: Corrected type annotation for dataclass attribute
pstats.FunctionProfile.ncalls
to bestr
.gh-95987: Fix
repr
ofAny
subclasses.gh-96388: Work around missing socket functions in
socket
's__repr__
.gh-96073: In
inspect
, fix overeager replacement of "typing.
" in formatting annotations.gh-96192: Fix handling of
bytes
path-like objects inos.ismount()
.gh-96052: Fix handling compiler warnings (SyntaxWarning and DeprecationWarning) in
codeop.compile_command()
when checking for incomplete input. Previously it emitted warnings and raised a SyntaxError. Now it always returnsNone
for incomplete input without emitting any warnings.gh-88863: To avoid apparent memory leaks when
asyncio.open_connection()
raises, break reference cycles generated by local exception and future instances (which has exception instance as its member var). Patch by Dong Uk, Kang.gh-91212: Fixed flickering of the turtle window when the tracer is turned off. Patch by Shin-myoung-serp.
gh-88050: Fix
asyncio
subprocess transport to kill process cleanly when process is blocked and avoidRuntimeError
when loop is closed. Patch by Kumar Aditya.gh-93858: Prevent error when activating venv in nested fish instances.
gh-91078:
TarFile.next()
now returnsNone
when called on an empty tarfile.bpo-47220: Document the optional callback parameter of
WeakMethod
. Patch by Géry Ogam.bpo-46364: Restrict use of sockets instead of pipes for stdin of subprocesses created by
asyncio
to AIX platform only.bpo-38523:
shutil.copytree()
now applies the ignore_dangling_symlinks argument recursively.bpo-36267: Fix IndexError in
argparse.ArgumentParser
when astore_true
action is given an explicit argument.
Documentation¶
gh-92892: Document that calling variadic functions with ctypes requires special care on macOS/arm64 (and possibly other platforms).
gh-85525: Remove extra row
gh-95588: Clarified the conflicting advice given in the
ast
documentation aboutast.literal_eval()
being "safe" for use on untrusted input while at the same time warning that it can crash the process. The latter statement is true and is deemed unfixable without a large amount of work unsuitable for a bugfix. So we keep the warning and no longer claim thatliteral_eval
is safe.bpo-41825: Restructured the documentation for the
os.wait*
family of functions, and improved the docs foros.waitid()
with more explanation of the possible argument constants.
Tests¶
gh-99892: Skip test_normalization() of test_unicodedata if it fails to download NormalizationTest.txt file from pythontest.net. Patch by Victor Stinner.
gh-99934: Correct test_marsh on (32 bit) x86: test_deterministic sets was failing.
gh-99659: Optional big memory tests in
test_sqlite3
now catch the correctsqlite.DataError
exception type in case of too large strings and/or blobs passed.gh-98713: Fix a bug in the
typing
tests where a test relying on CPython-specific implementation details was not decorated with@cpython_only
and was not skipped on other implementations.gh-87390: Add tests for star-unpacking with PEP 646, and some other miscellaneous PEP 646 tests.
gh-96853: Added explicit coverage of
Py_Initialize
(and hencePy_InitializeEx
) back to the embedding tests (all other embedding tests migrated toPy_InitializeFromConfig
in Python 3.11)bpo-34272: Some C API tests were moved into the new Lib/test/test_capi/ directory.
Build¶
gh-99086: Fix
-Wimplicit-int
,-Wstrict-prototypes
, and-Wimplicit-function-declaration
compiler warnings in configure checks.gh-99337: Fix a compilation issue with GCC 12 on macOS.
gh-99086: Fix
-Wimplicit-int
compiler warning in configure check forPTHREAD_SCOPE_SYSTEM
.gh-98872: Fix a possible fd leak in
Programs/_freeze_module.c
introduced in Python 3.11.gh-99016: Fix build with
PYTHON_FOR_REGEN=python3.8
.gh-97731: Specify the full path to the source location for
make docclean
(needed for cross-builds).gh-98707: Don't use vendored
libmpdec
headers if--with-system-libmpdec
is passed to configure. Don't use vendoredlibexpat
headers if--with-system-expat
is passed to !configure.gh-96761: Fix the build process of clang compiler for _bootstrap_python if LTO optimization is applied. Patch by Matthias Görgens and Donghee Na.
gh-96883:
wasm32-emscripten
builds for browsers now includeconcurrent.futures
forasyncio
andunittest.mock
.gh-84461:
wasm32-emscripten
platform no longer buildsresource
module,getresuid()
,getresgid()
, and their setters. The APIs are stubs and not functional.gh-94280: Updated pegen regeneration script on Windows to find and use Python 3.9 or higher. Prior to this, pegen regeneration already required 3.9 or higher, but the script may have used lower versions of Python.
Windows¶
gh-99345: Use faster initialization functions to detect install location for Windows Store package
gh-98629: Fix initialization of
sys.version
andsys._git
on Windowsgh-99442: Fix handling in Lanceur Python pour Windows when
argv[0]
does not include a file extension.gh-98689: Update Windows builds to zlib v1.2.13. v1.2.12 has CVE-2022-37434, but the vulnerable
inflateGetHeader
API is not used by Python.gh-98790: Assumes that a missing
DLLs
directory means that standard extension modules are in the executable's directory.gh-98745: Update
py.exe
launcher to install 3.11 by default and 3.12 on request.gh-98692: Fix the Lanceur Python pour Windows ignoring unrecognized shebang lines instead of treating them as local paths
gh-94328: Update Windows installer to use SQLite 3.39.4.
gh-97728: Fix possible crashes caused by the use of uninitialized variables when pass invalid arguments in
os.system()
on Windows and in Windows-specific modules (likewinreg
).gh-96965: Update libffi to 3.4.3
gh-94781: Fix
pcbuild.proj
to clean previous instances of ouput files inPython\deepfreeze
andPython\frozen_modules
directories on Windows. Patch by Charlie Zhao.bpo-40882: Fix a memory leak in
multiprocessing.shared_memory.SharedMemory
on Windows.
macOS¶
IDLE¶
gh-97527: Fix a bug in the previous bugfix that caused IDLE to not start when run with 3.10.8, 3.12.0a1, and at least Microsoft Python 3.10.2288.0 installed without the Lib/test package. 3.11.0 was never affected.
Tools/Demos¶
gh-95853: The
wasm_build.py
script now pre-builds Emscripten ports, checks for broken EMSDK versions, and warns about pkg-config env vars.gh-95853: The new tool
Tools/wasm/wasm_builder.py
automates configure, compile, and test steps for building CPython on WebAssembly platforms.gh-95731: Fix handling of module docstrings in
Tools/i18n/pygettext.py
.
C API¶
gh-98680:
PyBUF_*
constants were marked as part of Limited API of Python 3.11+. These were available in 3.11.0 withPy_LIMITED_API
defined for 3.11, and are necessary to use the buffer API.gh-98978: Fix use-after-free in
Py_SetPythonHome(NULL)
,Py_SetProgramName(NULL)
and_Py_SetProgramFullPath(NULL)
function calls. Issue reported by Benedikt Reinartz. Patch by Victor Stinner.gh-96853:
Py_InitializeEx
now correctly callsPyConfig_Clear
after initializing the interpreter (the omission didn't cause a memory leak only because none of the dynamically allocated config fields are populated by the wrapper function)
Python 3.11.0 final¶
Release date: 2022-10-24
Security¶
gh-97616: Fix multiplying a list by an integer (
list *= int
): detect the integer overflow when the new allocated length is close to the maximum size. Issue reported by Jordan Limor. Patch by Victor Stinner.gh-97514: On Linux the
multiprocessing
module returns to using filesystem backed unix domain sockets for communication with the forkserver process instead of the Linux abstract socket namespace. Only code that chooses to use the "forkserver" start method is affected.Abstract sockets have no permissions and could allow any user on the system in the same network namespace (often the whole system) to inject code into the multiprocessing forkserver process. This was a potential privilege escalation. Filesystem based socket permissions restrict this to the forkserver process user as was the default in Python 3.8 and earlier.
This prevents Linux CVE-2022-42919.
Core and Builtins¶
gh-97002: Fix an issue where several frame objects could be backed by the same interpreter frame, possibly leading to corrupted memory and hard crashes of the interpreter.
gh-97752: Fix possible data corruption or crashes when accessing the
f_back
member of newly-created generator or coroutine frames.gh-96975: Fix a crash occurring when
PyEval_GetFrame()
is called while the topmost Python frame is in a partially-initialized state.gh-96848: Fix command line parsing: reject
-X int_max_str_digits
option with no value (invalid) when thePYTHONINTMAXSTRDIGITS
environment variable is set to a valid limit. Patch by Victor Stinner.gh-96821: Fix undefined behaviour in
_testcapimodule.c
.gh-95778: When
ValueError
is raised if an integer is larger than the limit, mention thesys.set_int_max_str_digits()
function in the error message. Patch by Victor Stinner.gh-96587: Correctly raise
SyntaxError
on exception groups (PEP 654) on python versions prior to 3.11bpo-42316: Document some places where an assignment expression needs parentheses.
Library¶
gh-98331: Update the bundled copies of pip and setuptools to versions 22.3 and 65.5.0 respectively.
gh-90985: Earlier in 3.11 we deprecated
asyncio.Task.cancel("message")
. We realized we were too harsh, and have undeprecated it.gh-97545: Make Semaphore run faster.
gh-96865: fix Flag to use boundary CONFORM
This restores previous Flag behavior of allowing flags with non-sequential values to be combined; e.g.
class Skip(Flag): TWO = 2 EIGHT = 8
Skip.TWO | Skip.EIGHT -> <Skip.TWO|EIGHT: 10>
gh-90155: Fix broken
asyncio.Semaphore
when acquire is cancelled.
Documentation¶
Tests¶
gh-95027: On Windows, when the Python test suite is run with the
-jN
option, the ANSI code page is now used as the encoding for the stdout temporary file, rather than using UTF-8 which can lead to decoding errors. Patch by Victor Stinner.
Build¶
gh-96729: Ensure that Windows releases built with
Tools\msi\buildrelease.bat
are upgradable to and from official Python releases.
Windows¶
gh-98360: Fixes
multiprocessing
spawning child processes on Windows from a virtual environment to ensure that child processes that also usemultiprocessing
to spawn more children will recognize that they are in a virtual environment.gh-98414: Fix
py.exe
launcher handling of-V:<company>/
option when default preferences have been set in environment variables or configuration files.gh-90989: Clarify some text in the Windows installer.
macOS¶
gh-97897: The macOS 13 SDK includes support for the
mkfifoat
andmknodat
system calls. Using thedir_fd
option with eitheros.mkfifo()
oros.mknod()
could result in a segfault if cpython is built with the macOS 13 SDK but run on an earlier version of macOS. Prevent this by adding runtime support for detection of these system calls ("weaklinking") as is done for other newer syscalls on macOS.
Python 3.11.0 release candidate 2¶
Release date: 2022-09-11
Security¶
gh-95778: Converting between
int
andstr
in bases other than 2 (binary), 4, 8 (octal), 16 (hexadecimal), or 32 such as base 10 (decimal) now raises aValueError
if the number of digits in string form is above a limit to avoid potential denial of service attacks due to the algorithmic complexity. This is a mitigation for CVE-2020-10735.This new limit can be configured or disabled by environment variable, command line flag, or
sys
APIs. See the integer string conversion length limitation documentation. The default limit is 4300 digits in string form.Patch by Gregory P. Smith [Google] and Christian Heimes [Red Hat] with feedback from Victor Stinner, Thomas Wouters, Steve Dower, Ned Deily, and Mark Dickinson.
Core and Builtins¶
gh-96678: Fix case of undefined behavior in ceval.c
gh-96641: Do not expose
KeyWrapper
in_functools
.gh-96636: Ensure that tracing,
sys.setrace()
, is turned on immediately. In pre-release versions of 3.11, some tracing events might have been lost when turning on tracing in a__del__
method or interrupt.gh-96572: Fix use after free in trace refs build mode. Patch by Kumar Aditya.
gh-96611: When loading a file with invalid UTF-8 inside a multi-line string, a correct SyntaxError is emitted.
gh-96612: Make sure that incomplete frames do not show up in tracemalloc traces.
gh-96569: Remove two cases of undefined behavior, by adding NULL checks.
gh-96582: Fix possible
NULL
pointer dereference in_PyThread_CurrentFrames
. Patch by Kumar Aditya.gh-96352: Fix
AttributeError
missingname
andobj
attributes inobject.__getattribute__()
. Patch by Philip Georgi.gh-96268: Loading a file with invalid UTF-8 will now report the broken character at the correct location.
gh-96187: Fixed a bug that caused
_PyCode_GetExtra
to return garbage for negative indexes. Patch by Pablo Galindogh-96071: Fix a deadlock in
PyGILState_Ensure()
when allocating new thread state. Patch by Kumar Aditya.gh-96046:
PyType_Ready()
now initializesht_cached_keys
and performs additional checks to ensure that type objects are properly configured. This avoids crashes in 3rd party packages that don't use regular API to create new types.gh-95818: Skip over incomplete frames in
PyThreadState_GetFrame()
.gh-95876: Fix format string in
_PyPegen_raise_error_known_location
that can lead to memory corruption on some 64bit systems. The function was building a tuple withi
(int) instead ofn
(Py_ssize_t) for Py_ssize_t arguments.gh-95605: Fix misleading contents of error message when converting an all-whitespace string to
float
.gh-94996:
ast.parse()
will no longer parse function definitions with positional-only params when passedfeature_version
less than(3, 8)
. Patch by Shantanu Jain.
Library¶
gh-96652: Fix the faulthandler implementation of
faulthandler.register(signal, chain=True)
if thesigaction()
function is not available: don't call the previous signal handler if it's NULL. Patch by Victor Stinner.gh-68163: Correct conversion of
numbers.Rational
's tofloat
.gh-96385: Fix
TypeVarTuple.__typing_prepare_subst__
.TypeError
was not raised when using more than oneTypeVarTuple
, like[*T, *V]
in type alias substitutions.gh-90467: Fix
asyncio.streams.StreamReaderProtocol
to keep a strong reference to the created task, so that it's not garbage collectedgh-96159: Fix a performance regression in logging TimedRotatingFileHandler. Only check for special files when the rollover time has passed.
gh-96175: Fix unused
localName
parameter in theAttr
class inxml.dom.minidom
.gh-96125: Fix incorrect condition that causes
sys.thread_info.name
to be wrong on pthread platforms.gh-95463: Remove an incompatible change from bpo-28080 that caused a regression that ignored the utf8 in
ZipInfo.flag_bits
. Patch by Pablo Galindo.gh-95899: Fix
asyncio.Runner
to callasyncio.set_event_loop()
only once to avoid callingattach_loop()
multiple times on child watchers. Patch by Kumar Aditya.gh-95736: Fix
unittest.IsolatedAsyncioTestCase
to set event loop before calling setup functions. Patch by Kumar Aditya.gh-95704: When a task catches
asyncio.CancelledError
and raises some other error, the other error should generally not silently be suppressed.gh-95231: Fail gracefully if
EPERM
orENOSYS
is raised when loadingcrypt
methods. This may happen when trying to loadMD5
on a Linux kernel with FIPS enabled.gh-74116: Allow
asyncio.StreamWriter.drain()
to be awaited concurrently by multiple tasks. Patch by Kumar Aditya.gh-92986: Fix
ast.unparse()
whenImportFrom.level
is None
Documentation¶
gh-96098: Improve discoverability of the higher level concurrent.futures module by providing clearer links from the lower level threading and multiprocessing modules.
gh-95957: What's New 3.11 now has instructions for how to provide compiler and linker flags for Tcl/Tk and OpenSSL on RHEL 7 and CentOS 7.
Tests¶
gh-95243: Mitigate the inherent race condition from using find_unused_port() in testSockName() by trying to find an unused port a few times before failing. Patch by Ross Burton.
Build¶
gh-94682: Build and test with OpenSSL 1.1.1q
Windows¶
Python 3.11.0 release candidate 1¶
Release date: 2022-08-05
Core and Builtins¶
gh-95150: Update code object hashing and equality to consider all debugging and exception handling tables. This fixes an issue where certain non-identical code objects could be "deduplicated" during compilation.
gh-95355:
_PyPegen_Parser_New
now properly detects token memory allocation errors. Patch by Honglin Zhu.gh-90081: Run Python code in tracer/profiler function at full speed. Fixes slowdown in earlier versions of 3.11.
gh-95324: Emit a warning in debug mode if an object does not call
PyObject_GC_UnTrack()
before deallocation. Patch by Pablo Galindo.gh-95185: Prevented crashes in the AST constructor when compiling some absurdly long expressions like
"+0"*1000000
.RecursionError
is now raised instead. Patch by Pablo Galindogh-93351:
ast.AST
node positions are now validated when provided tocompile()
and other related functions. If invalid positions are detected, aValueError
will be raised.gh-94938: Fix error detection in some builtin functions when keyword argument name is an instance of a str subclass with overloaded
__eq__
and__hash__
. Previously it could cause SystemError or other undesired behavior.
Library¶
gh-95609: Update bundled pip to 22.2.2.
gh-95289: Fix
asyncio.TaskGroup
to propagate exception whenasyncio.CancelledError
was replaced with another exception by a context manger. Patch by Kumar Aditya and Guido van Rossum.gh-95339: Update bundled pip to 22.2.1.
gh-95045: Fix GC crash when deallocating
_lsprof.Profiler
by untracking it before calling any callbacks. Patch by Kumar Aditya.gh-95097: Fix
asyncio.run()
forasyncio.Task
implementations withoutuncancel()
method. Patch by Kumar Aditya.gh-93899: Fix check for existence of
os.EFD_CLOEXEC
,os.EFD_NONBLOCK
andos.EFD_SEMAPHORE
flags on older kernel versions where these flags are not present. Patch by Kumar Aditya.gh-95166: Fix
concurrent.futures.Executor.map()
to cancel the currently waiting on future on an error - e.g. TimeoutError or KeyboardInterrupt.gh-95109: Ensure that timeouts scheduled with
asyncio.Timeout
that have already expired are delivered promptly.gh-91810: Suppress writing an XML declaration in open files in
ElementTree.write()
withencoding='unicode'
andxml_declaration=None
.gh-91447: Fix findtext in the xml module to only give an empty string when the text attribute is set to None.
Documentation¶
gh-91207: Fix stylesheet not working in Windows CHM htmlhelp docs and add warning that they are deprecated. Contributed by C.A.M. Gerlach.
gh-95451: Update library documentation with availability information on WebAssembly platforms
wasm32-emscripten
andwasm32-wasi
.gh-95415: Use consistent syntax for platform availability. The directive now supports a content body and emits a warning when it encounters an unknown platform.
gh-86128: Document a limitation in ThreadPoolExecutor where its exit handler is executed before any handlers in atexit.
Tests¶
gh-95573: Lib/test/test_asyncio/test_ssl.py exposed a bug in the macOS kernel where intense concurrent load on non-blocking sockets occasionally causes
errno.ENOBUFS
("No buffer space available") to be emitted. FB11063974 filed with Apple, in the mean time as a workaround buffer size used in tests on macOS is decreased to avoid intermittent failures. Patch by Fantix King.gh-95280: Fix problem with
test_ssl
test_get_ciphers
on systems that require perfect forward secrecy (PFS) ciphers.gh-94675: Add a regression test for
re
exponentional slowdown when using rjsmin.
Build¶
gh-94801: Fix a regression in
configure
script that caused some header checks to ignore customCPPFLAGS
. The regression was introduced in gh-94802.gh-95145: wasm32-wasi builds no longer depend on WASIX's pthread stubs. Python now has its own stubbed pthread API.
gh-95174: Python now detects missing
dup
function in WASI and works around some missingerrno
,select
, andsocket
constants.gh-95174: Python now skips missing
socket
functions and methods on WASI. WASI can only create sockets from existing fd / accept and has no netdb.gh-95085: Platforms
wasm32-unknown-emscripten
andwasm32-unknown-wasi
have been promoted to PEP 11 tier 3 platform support.
Windows¶
gh-95656: Enable the
enable_load_extension()
sqlite3
API.gh-95587: Fixes some issues where the Windows installer would incorrectly detect certain features of an existing install when upgrading.
gh-94399: Restores the behaviour of Lanceur Python pour Windows for
/usr/bin/env
shebang lines, which will now searchPATH
for an executable matching the given command. If none is found, the usual search process is used.gh-95445: Fixes the unsuccessful removal of the HTML document directory when uninstalling with Windows msi.
gh-95359: Fix Lanceur Python pour Windows handling of
py.ini
commands (it was incorrectly expecting apy_
prefix on keys) and crashes when reading per-user configuration file.gh-95285: Fix Lanceur Python pour Windows handling of command lines where it is only passed a short executable name.
IDLE¶
gh-65802: Document handling of extensions in Save As dialogs.
gh-95191: Include prompts when saving Shell (interactive input and output).
gh-95511: Fix the Shell context menu copy-with-prompts bug of copying an extra line when one selects whole lines.
gh-95471: In the Edit menu, move
Select All
and add a new separator.gh-95411: Enable using IDLE's module browser with .pyw files.
gh-89610: Add .pyi as a recognized extension for IDLE on macOS. This allows opening stub files by double clicking on them in the Finder.
C API¶
gh-92678: Restore the 3.10 behavior for multiple inheritance of C extension classes that store their dictionary at the end of the struct.
gh-94936: Added
PyCode_GetVarnames()
,PyCode_GetCellvars()
andPyCode_GetFreevars()
for accessingco_varnames
,co_cellvars
andco_freevars
respectively via the C API.
Python 3.11.0 beta 5¶
Release date: 2022-07-25
Core and Builtins¶
gh-93351:
ast.AST
node positions are now validated when provided tocompile()
and other related functions. If invalid positions are detected, aValueError
will be raised.gh-94438: Fix an issue that caused extended opcode arguments and some conditional pops to be ignored when calculating valid jump targets for assignments to the
f_lineno
attribute of frame objects. In some cases, this could cause inconsistent internal state, resulting in a hard crash of the interpreter.gh-95060: Undocumented
PyCode_Addr2Location
function now properly returns whenaddrq
argument is less than zero.gh-95113: Replace all
EXTENDED_ARG_QUICK
instructions with basicEXTENDED_ARG
instructions in unquickened code. Consumers of non-adaptive bytecode should be able to handle extended arguments the same way they were handled in CPython 3.10 and older.gh-91409: Fix incorrect source location info caused by certain optimizations in the bytecode compiler.
gh-94036: Fix incorrect source location info for some multi-line attribute accesses and method calls.
gh-94739: Allow jumping within, out of, and across exception handlers in the debugger.
gh-94949:
ast.parse()
will no longer parse parenthesized context managers when passedfeature_version
less than(3, 9)
. Patch by Shantanu Jain.gh-94947:
ast.parse()
will no longer parse assignment expressions when passedfeature_version
less than(3, 8)
. Patch by Shantanu Jain.gh-91256: Ensures the program name is known for help text during interpreter startup.
gh-94869: Fix the column offsets for some expressions in multi-line f-strings
ast
nodes. Patch by Pablo Galindo.gh-94822: Fix an issue where lookups of metaclass descriptors may be ignored when an identically-named attribute also exists on the class itself.
gh-91153: Fix an issue where a
bytearray
item assignment could crash if it's resized by the new value's__index__()
method.gh-90699: Fix reference counting bug in
bool.__repr__()
. Patch by Kumar Aditya.
Library¶
gh-95087: Fix IndexError in parsing invalid date in the
email
module.gh-95199: Upgrade bundled setuptools to 63.2.0.
gh-95194: Upgrade bundled pip to 22.2.
gh-95132: Fix a
sqlite3
regression where*args
and**kwds
were incorrectly relayed fromconnect()
to theConnection
factory. The regression was introduced in 3.11a1 with PR 24421 (gh-85128). Patch by Erlend E. Aasland.`gh-93157: Fix
fileinput
module didn't supporterrors
option wheninplace
is true.gh-95105:
wsgiref.types.InputStream.__iter__()
should returnIterator[bytes]
, notIterable[bytes]
. Patch by Shantanu Jain.gh-94857: Fix refleak in
_io.TextIOWrapper.reconfigure
. Patch by Kumar Aditya.gh-94821: Fix binding of unix socket to empty address on Linux to use an available address from the abstract namespace, instead of "0".
gh-89988: Fix memory leak in
pickle.Pickler
when looking updispatch_table
. Patch by Kumar Aditya.
Tests¶
gh-95212: Make multiprocessing test case
test_shared_memory_recreate
parallel-safe.
Build¶
gh-94847: Fixed
_decimal
module build issue on GCC when compiling with LTO and pydebug. Debug builds no longer force inlining of functions.gh-94841: Fix the possible performance regression of
PyObject_Free()
compiled with MSVC version 1932.gh-94801:
configure
now uses custom flags likeZLIB_CFLAGS
andZLIB_LIBS
when searching for headers and libraries.gh-94773:
deepfreeze.py
now supports code object with frozensets that contain incompatible, unsortable types.
Windows¶
C API¶
gh-92678: Adds unstable C-API functions
_PyObject_VisitManagedDict
and_PyObject_ClearManagedDict
to allow C extensions to allow the VM to manage their object's dictionaries.gh-94930: Fix
SystemError
raised whenPyArg_ParseTupleAndKeywords()
is used with#
in(...)
but withoutPY_SSIZE_T_CLEAN
defined.gh-94864: Fix
PyArg_Parse*
with deprecated format units "u" and "Z". It returned 1 (success) when warnings are turned into exceptions.gh-94731: Python again uses C-style casts for most casting operations when compiled with C++. This may trigger compiler warnings, if they are enabled with e.g.
-Wold-style-cast
or-Wzero-as-null-pointer-constant
options forg++
.
Python 3.11.0 beta 4¶
Release date: 2022-07-11
Security¶
gh-87389:
http.server
: Fix an open redirection vulnerability in the HTTP server when an URI path starts with//
. Vulnerability discovered, and initial fix proposed, by Hamza Avvan.gh-79096: LWPCookieJar and MozillaCookieJar create files with file mode 600 instead of 644 (Microsoft Windows is not affected)
gh-92888: Fix
memoryview
use after free when accessing the backing buffer in certain cases.gh-68966: The deprecated mailcap module now refuses to inject unsafe text (filenames, MIME types, parameters) into shell commands. Instead of using such text, it will warn and act as if a match was not found (or for test commands, as if the test failed).
Core and Builtins¶
gh-94694: Fix an issue that could cause code with multi-line method lookups to have misleading or incorrect column offset information. In some cases (when compiling a hand-built AST) this could have resulted in a hard crash of the interpreter.
gh-93252: Fix an issue that caused internal frames to outlive failed Python function calls, possibly resulting in memory leaks or hard interpreter crashes.
gh-94215: Fix an issue where exceptions raised by line-tracing events would cause frames to be left in an invalid state, possibly resulting in a hard crash of the interpreter.
gh-92228: Disable the compiler's inline-small-exit-blocks optimization for exit blocks that are associated with source code lines. This fixes a bug where the debugger cannot tell where an exception handler ends and the following code block begins.
gh-94485: Line number of a module's
RESUME
instruction is set to 0 as specified in PEP 626.gh-94438: Account for instructions that can push NULL to the stack when setting line number in a frame. Prevents some (unlikely) crashes.
gh-91719: Reload
opcode
when raisingunknown opcode error
in the interpreter main loop, for C compilers to generate dispatching code independently.gh-94329: Compile and run code with unpacking of extremely large sequences (1000s of elements). Such code failed to compile. It now compiles and runs correctly.
gh-94360: Fixed a tokenizer crash when reading encoded files with syntax errors from
stdin
with non utf-8 encoded text. Patch by Pablo Galindogh-88116: Fix an issue when reading line numbers from code objects if the encoded line numbers are close to
INT_MIN
. Patch by Pablo Galindogh-94262: Don't create frame objects for incomplete frames. Prevents the creation of generators and closures from being observable to Python and C extensions, restoring the behavior of 3.10 and earlier.
gh-94192: Fix error for dictionary literals with invalid expression as value.
gh-93883: Revise the display strategy of traceback enhanced error locations. The indicators are only shown when the location doesn't span the whole line.
gh-94021: Fix unreachable code warning in
Python/specialize.c
.gh-93516: Store offset of first traceable instruction in code object to avoid having to recompute it for each instruction when tracing.
gh-93516: Lazily create a table mapping bytecode offsets to line numbers to speed up calculation of line numbers when tracing.
gh-89828:
types.GenericAlias
no longer relays the__class__
attribute. For example,isinstance(list[int], type)
no longer returnsTrue
.gh-93671: Fix some exponential backtrace case happening with deeply nested sequence patterns in match statements. Patch by Pablo Galindo
gh-93662: Make sure that the end column offsets are correct in multi-line method calls. Previously, the end column could precede the column offset.
gh-93461:
importlib.invalidate_caches()
now drops entries fromsys.path_importer_cache
with a relative path as name. This solves a caching issue when a process changes its current working directory.FileFinder
no longer inserts a dot in the path, e.g./egg/./spam
is now/egg/spam
.gh-93418: Fixed an assert where an f-string has an equal sign '=' following an expression, but there's no trailing brace. For example, f"{i=".
gh-93382: Cache the result of
PyCode_GetCode()
function to restore the O(1) lookup of theco_code
attribute.gh-93354: Use exponential backoff for specialization counters in the interpreter. Can reduce the number of failed specializations significantly and avoid slowdown for those parts of a program that are not suitable for specialization.
gh-93021: Fix the
__text_signature__
for__get__()
methods implemented in C. Patch by Jelle Zijlstra.gh-92930: Fixed a crash in
_pickle.c
from mutating collections during__reduce__
orpersistent_id
.gh-92914: Always round the allocated size for lists up to the nearest even number.
gh-92858: Improve error message for some suites with syntax error before ':'
bpo-46142: Make
--help
output shorter by moving some info to the new--help-env
and--help-xoptions
command-line options. Also add--help-all
option to print complete usage.
Library¶
gh-94736: Fix crash when deallocating an instance of a subclass of
_multiprocessing.SemLock
. Patch by Kumar Aditya.gh-94637:
SSLContext.set_default_verify_paths()
now releases the GIL aroundSSL_CTX_set_default_verify_paths
call. The function call performs I/O and CPU intensive work.gh-94607: Fix subclassing complex generics with type variables in
typing
. Previously an error message sayingSome type variables ... are not listed in Generic[...]
was shown.typing
no longer populates__parameters__
with the__parameters__
of a Python class.gh-93910: The ability to access the other values of an enum on an enum (e.g.
Color.RED.BLUE
) has been restored in order to fix a performance regression.gh-93896: Fix
asyncio.run()
andunittest.IsolatedAsyncioTestCase
to always the set event loop as it was done in Python 3.10 and earlier. Patch by Kumar Aditya.gh-94510: Re-entrant calls to
sys.setprofile()
andsys.settrace()
now raiseRuntimeError
. Patch by Pablo Galindo.gh-92336: Fix bug where
linecache.getline()
fails on bad files withUnicodeDecodeError
orSyntaxError
. It now returns an empty string as per the documentation.gh-94398: Once a
asyncio.TaskGroup
has started shutting down (i.e., at least one task has failed and the task group has started cancelling the remaining tasks), it should not be possible to add new tasks to the task group.gh-94254: Fixed types of
struct
module to be immutable. Patch by Kumar Aditya.gh-94207: Made
_struct.Struct
GC-tracked in order to fix a reference leak in the_struct
module.gh-91742: Fix
pdb
crash after jump caused by a null pointer dereference. Patch by Kumar Aditya.gh-94101: Manual instantiation of
ssl.SSLSession
objects is no longer allowed as it lead to misconfigured instances that crashed the interpreter when attributes where accessed on them.gh-84753:
inspect.iscoroutinefunction()
,inspect.isgeneratorfunction()
, andinspect.isasyncgenfunction()
now properly returnTrue
for duck-typed function-like objects like instances ofunittest.mock.AsyncMock
.This makes
inspect.iscoroutinefunction()
consistent with the behavior ofasyncio.iscoroutinefunction()
. Patch by Mehdi ABAAKOUK.gh-94028: Fix a regression in the
sqlite3
where statement objects were not properly cleared and reset after use in cursor iters. The regression was introduced by PR 27884 in Python 3.11a1. Patch by Erlend E. Aasland.gh-93847: Fix repr of enum of generic aliases.
gh-91404: Revert the
re
memory leak when a match is terminated by a signal or memory allocation failure as the implemented fix caused a major performance regression.gh-83499: Fix double closing of file description in
tempfile
.gh-93820: Fixed a regression when
copy.copy()
-ingenum.Flag
with multiple flag members.gh-79512: Fixed names and
__module__
value ofweakref
classesReferenceType
,ProxyType
,CallableProxyType
. It makes them pickleable.gh-91389: Fix an issue where
dis
utilities could report missing or incorrect position information in the presence ofCACHE
entries.gh-93626: Set
__future__.annotations
to have aNone
mandatoryRelease to indicate that it is currently 'TBD'.gh-90473: Emscripten and WASI have no home directory and cannot provide PEP 370 user site directory.
gh-90494:
copy.copy()
andcopy.deepcopy()
now always raise a TypeError if__reduce__()
returns a tuple with length 6 instead of silently ignore the 6th item or produce incorrect result.gh-90549: Fix a multiprocessing bug where a global named resource (such as a semaphore) could leak when a child process is spawned (as opposed to forked).
gh-93521: Fixed a case where dataclasses would try to add
__weakref__
into the__slots__
for a dataclass that specifiedweakref_slot=True
when it was already defined in one of its bases. This resulted in aTypeError
upon the new class being created.gh-79579:
sqlite3
now correctly detects DML queries with leading comments. Patch by Erlend E. Aasland.gh-93421: Update
sqlite3.Cursor.rowcount
when a DML statement has run to completion. This fixes the row count for SQL queries likeUPDATE ... RETURNING
. Patch by Erlend E. Aasland.gh-91162: Support splitting of unpacked arbitrary-length tuple over
TypeVar
andTypeVarTuple
parameters. For example:A[T, *Ts][*tuple[int, ...]]
->A[int, *tuple[int, ...]]
A[*Ts, T][*tuple[int, ...]]
->A[*tuple[int, ...], int]
gh-93353: Fix the
importlib.resources.as_file()
context manager to remove the temporary file if destroyed late during Python finalization: keep a local reference to theos.remove()
function. Patch by Victor Stinner.gh-83658: Make
multiprocessing.Pool
raise an exception ifmaxtasksperchild
is notNone
or a positive int.gh-93156: Accessing the
pathlib.PurePath.parents
sequence of an absolute path using negative index values produced incorrect results.gh-74696:
shutil.make_archive()
no longer temporarily changes the current working directory during creation of standard.zip
or tar archives.gh-89973: Fix
re.error
raised infnmatch
if the pattern contains a character range with upper bound lower than lower bound (e.g.[c-a]
). Now such ranges are interpreted as empty ranges.gh-92932: Now
dis()
andget_instructions()
handle operand values for instructions prefixed byEXTENDED_ARG_QUICK
. Patch by Sam Gross and Donghee Na.gh-91577: Move imports in
SharedMemory
methods to module level so that they can be executed late in python finalization.gh-91456: Deprecate current default auto() behavior: In 3.13 the default will be for for auto() to always return the largest member value incremented by 1, and to raise if incompatible value types are used.
bpo-47231: Fixed an issue with inconsistent trailing slashes in tarfile longname directories.
bpo-46755: In
QueueHandler
, clearstack_info
fromLogRecord
to prevent stack trace from being written twice.bpo-46197: Fix
ensurepip
environment isolation for subprocess runningpip
.bpo-45924: Fix
asyncio
incorrect traceback when future's exception is raised multiple times. Patch by Kumar Aditya.bpo-34828:
sqlite3.Connection.iterdump()
now handles databases that useAUTOINCREMENT
in one or more tables.
Documentation¶
gh-94321: Document the PEP 246 style protocol type
sqlite3.PrepareProtocol
.gh-61162: Clarify
sqlite3
behavior when How to use the connection context manager.gh-87260: Align
sqlite3
argument specs with the actual implementation.gh-86986: The minimum Sphinx version required to build the documentation is now 3.2.
gh-88831: Augmented documentation of asyncio.create_task(). Clarified the need to keep strong references to tasks and added a code snippet detailing how to to this.
bpo-47161: Document that
pathlib.PurePath
does not collapse initial double slashes because they denote UNC paths.
Tests¶
gh-91330: Added more tests for
dataclasses
to cover behavior with data descriptor-based fields.gh-94208:
test_ssl
is now checking for supported TLS version and protocols in more tests.gh-94315: Tests now check for DAC override capability instead of relying on
os.geteuid()
.gh-93951: In test_bdb.StateTestCase.test_skip, avoid including auxiliary importers.
gh-93957: Provide nicer error reporting from subprocesses in test_venv.EnsurePipTest.test_with_pip.
gh-84461:
run_tests.py
now handles cross compiling env vars correctly and passHOSTRUNNER
to regression tests.gh-93616:
test_modulefinder
now creates a temporary directory inModuleFinderTest.setUp()
instead of module scope.gh-93575: Fix issue with test_unicode test_raiseMemError. The test case now use
test.support.calcobjsize
to calculate size of PyUnicode structs.sys.getsizeof()
may return different size when string has UTF-8 memory.gh-90473: WASI does not have a
chmod(2)
syscall.os.chmod()
is now a dummy function on WASI. Skip all tests that depend on workingos.chmod()
.gh-90473: Skip tests on WASI that require symlinks with absolute paths.
gh-57539: Increase calendar test coverage for
calendar.LocaleTextCalendar.formatweekday()
.gh-90473: Skip symlink tests on WASI. wasmtime uses
openat2(2)
withRESOLVE_BENEATH
flag, which prevents symlinks with absolute paths.gh-89858: Fix
test_embed
for out-of-tree builds. Patch by Kumar Aditya.gh-92886: Fixing tests that fail when running with optimizations (
-O
) intest_imaplib.py
.gh-92886: Fixing tests that fail when running with optimizations (
-O
) intest_zipimport.py
bpo-47016: Create a GitHub Actions workflow for verifying bundled pip and setuptools. Patch by Illia Volochii and Adam Turner.
Build¶
gh-94404:
makesetup
now works around an issue with sed on macOS and uses correct CFLAGS for object files that end up in a shared extension. Module CFLAGS are used before PY_STDMODULE_CFLAGS to avoid clashes with system headers.gh-93584: Address race condition in
Makefile
when installing a PGO build. Alltest
andinstall
targets now depend onall
target.gh-93491:
configure
now detects and reports PEP 11 support tiers.
Windows¶
gh-93824: Drag and drop of files onto Python files in Windows Explorer has been enabled for Windows ARM64.
bpo-42658: Support native Windows case-insensitive path comparisons by using
LCMapStringEx
instead ofstr.lower()
inntpath.normcase()
. AddLCMapStringEx
to the_winapi
module.
Tools/Demos¶
C API¶
gh-93937: The following frame functions and type are now directly available with
#include <Python.h>
, it's no longer needed to add#include <frameobject.h>
:Patch by Victor Stinner.
gh-91321: Fix the compatibility of the Python C API with C++ older than C++11. Patch by Victor Stinner.
gh-91731: Avoid defining the
static_assert
when compiling with C++ 11, where this is a keyword and redefining it can lead to undefined behavior. Patch by Pablo Galindogh-93442: Add C++ overloads for _Py_CAST_impl() to handle 0/NULL. This will allow C++ extensions that pass 0 or NULL to macros using _Py_CAST() to continue to compile.
Python 3.11.0 beta 3¶
Release date: 2022-06-01
Core and Builtins¶
Build¶
gh-69093: Fix
Modules/Setup.stdlib.in
rule for_sqlite3
extension.
Python 3.11.0 beta 2¶
Release date: 2022-05-30
Core and Builtins¶
gh-84694: The
--experimental-isolated-subinterpreters
configure option andEXPERIMENTAL_ISOLATED_SUBINTERPRETERS
macro have been removed.gh-91924: Fix
__lltrace__
debug feature if the stdout encoding is not UTF-8. Patch by Victor Stinner.gh-93061: Backward jumps after
async for
loops are no longer given dubious line numbers.gh-93065: Fix contextvars HAMT implementation to handle iteration over deep trees.
The bug was discovered and fixed by Eli Libman. See MagicStack/immutables#84 for more details.
gh-90473: Decrease default recursion limit on WASI to address limited call stack size.
gh-92804: Fix memory leak in
memoryview
iterator as it was not finalized at exit. Patch by Kumar Aditya.gh-92236: Remove spurious "LINE" event when starting a generator or coroutine, visible tracing functions implemented in C.
gh-92619: Make the compiler duplicate an exit block only if none of its instructions have a lineno (previously only the first instruction in the block was checked, leading to unnecessarily duplicated blocks).
gh-92261: Fix hang when trying to iterate over a
typing.Union
.
Library¶
gh-93297: Make asyncio task groups prevent child tasks from being GCed
gh-90817: The
locale.resetlocale()
function is deprecated and will be removed in Python 3.13. Uselocale.setlocale(locale.LC_ALL, "")
instead. Patch by Victor Stinner.gh-92728: The
re.template()
function and the correspondingre.TEMPLATE
andre.T
flags are restored after they were removed in 3.11.0b1, but they are now deprecated, so they might be removed from Python 3.13.gh-93044: No longer convert the database argument of
sqlite3.connect()
to bytes before passing it to the factory.gh-93010: In a very special case, the email package tried to append the nonexistent
InvalidHeaderError
to the defect list. It should have beenInvalidHeaderDefect
.gh-92675: Fix
venv.ensure_directories()
to acceptpathlib.Path
arguments in addition tostr
paths. Patch by David Foster.gh-87901: Removed the
encoding
argument fromos.popen()
that was added in 3.11b1.gh-91922: Fix function
sqlite.connect()
and thesqlite.Connection
constructor on non-UTF-8 locales. Also, they now support bytes paths non-decodable with the current FS encoding.gh-92839: Fixed crash resulting from calling bisect.insort() or bisect.insort_left() with the key argument not equal to None.
gh-90473:
subprocess
now fails early on Emscripten and WASI platforms to work around missingos.pipe()
on WASI.gh-92671: Fixed
ast.unparse()
for empty tuples in the assignment target context.gh-91581:
utcfromtimestamp()
no longer attempts to resolvefold
in the pure Python implementation, since the fold is never 1 in UTC. In addition to being slightly faster in the common case, this also prevents some errors when the timestamp is close todatetime.min
. Patch by Paul Ganssle.gh-92550: Fix
pathlib.Path.rglob()
for empty pattern.gh-92530: Fix an issue that occurred after interrupting
threading.Condition.notify()
.gh-92531: The statistics.median_grouped() function now always return a float. Formerly, it did not convert the input type when for sequences of length one.
gh-91810:
ElementTree
methodwrite()
and functiontostring()
now use the text file's encoding ("UTF-8" if not available) instead of locale encoding in XML declaration whenencoding="unicode"
is specified.gh-90622: Worker processes for
concurrent.futures.ProcessPoolExecutor
are no longer spawned on demand (a feature added in 3.9) when the multiprocessing context start method is"fork"
as that can lead to deadlocks in the child processes due to a fork happening while threads are running.gh-91581: Remove an unhandled error case in the C implementation of calls to
datetime.fromtimestamp
with no time zone (i.e. getting a local time from an epoch timestamp). This should have no user-facing effect other than giving a possibly more accurate error message when called with timestamps that fall on 10000-01-01 in the local time. Patch by Paul Ganssle.bpo-39064:
zipfile.ZipFile
now raiseszipfile.BadZipFile
instead ofValueError
when reading a corrupt zip file in which the central directory offset is negative.bpo-45393: Fix the formatting for
await x
andnot x
in the operator precedence table when using thehelp()
system.bpo-28249: Set
doctest.DocTest.lineno
toNone
when object does not have__doc__
.bpo-45046: Add support of context managers in
unittest
: methodsenterContext()
andenterClassContext()
of classTestCase
, methodenterAsyncContext()
of classIsolatedAsyncioTestCase
and functionunittest.enterModuleContext()
.bpo-42627: Fix incorrect parsing of Windows registry proxy settings
Documentation¶
gh-86438: Clarify that
-W
andPYTHONWARNINGS
are matched literally and case-insensitively, rather than as regular expressions, inwarnings
.gh-92240: Added release dates for "What's New in Python 3.X" for 3.0, 3.1, 3.2, 3.8 and 3.10
bpo-40838: Document that
inspect.getdoc()
,inspect.getmodule()
, andinspect.getsourcefile()
might returnNone
.bpo-38056: Overhaul the Gestionnaires d'erreurs documentation in
codecs
.bpo-13553: Document tkinter.Tk args.
Tests¶
gh-92670: Skip
test_shutil.TestCopy.test_copyfile_nonexistent_dir
test on AIX as the test uses a trailing slash to force the OS consider the path as a directory, but on AIX the trailing slash has no effect and is considered as a file.
Build¶
Windows¶
gh-92817: Ensures that
py.exe
will prefer an active virtual environment over default tags specified with environment variables or through apy.ini
file.gh-92984: Explicitly disable incremental linking for non-Debug builds
gh-92841:
asyncio
no longer throwsRuntimeError: Event loop is closed
on interpreter exit after asynchronous socket activity. Patch by Oleg Iarygin.bpo-46907: Update Windows installer to use SQLite 3.38.4.
C API¶
gh-92898: Fix C++ compiler warnings when casting function arguments to
PyObject*
. Patch by Serge Guelton.gh-92913: Ensures changes to
PyConfig.module_search_paths
are ignored unlessPyConfig.module_search_paths_set
is setgh-92781: Avoid mixing declarations and code in the C API to fix the compiler warning: "ISO C90 forbids mixed declarations and code" [-Werror=declaration-after-statement]. Patch by Victor Stinner.
Python 3.11.0 beta 1¶
Release date: 2022-05-06
Security¶
gh-57684: Add the
-P
command line option and thePYTHONSAFEPATH
environment variable to not prepend a potentially unsafe path tosys.path
. Patch by Victor Stinner.
Core and Builtins¶
gh-89519: Chaining classmethod descriptors (introduced in bpo-19072) is deprecated. It can no longer be used to wrap other descriptors such as property(). The core design of this feature was flawed, and it caused a number of downstream problems.
gh-92345:
pymain_run_python()
now importsreadline
andrlcompleter
before sys.path is extended to include the current working directory of an interactive interpreter. Non-interactive interpreters are not affected.bpo-43857: Improve the
AttributeError
message when deleting a missing attribute. Patch by Géry Ogam.gh-92245: Make sure that PEP 523 is respected in all cases. In 3.11a7, specialization may have prevented Python-to-Python calls respecting PEP 523.
gh-92203: Add a closure keyword-only parameter to exec(). It can only be specified when exec-ing a code object that uses free variables. When specified, it must be a tuple, with exactly the number of cell variables referenced by the code object. closure has a default value of None, and it must be None if the code object doesn't refer to any free variables.
gh-91173: Disable frozen modules in debug builds. Patch by Kumar Aditya.
gh-92114: Improve error message when subscript a type with
__class_getitem__
set toNone
.gh-92112: Fix crash triggered by an evil custom
mro()
on a metaclass.gh-92063: The
PRECALL_METHOD_DESCRIPTOR_FAST_WITH_KEYWORDS
instruction now ensures methods are called only on objects of the correct type.gh-92031: Deoptimize statically allocated code objects during
Py_FINALIZE()
so that future_PyCode_Quicken
calls always start with unquickened code.gh-92036: Fix a crash in subinterpreters related to the garbage collector. When a subinterpreter is deleted, untrack all objects tracked by its GC. To prevent a crash in deallocator functions expecting objects to be tracked by the GC, leak a strong reference to these objects on purpose, so they are never deleted and their deallocator functions are not called. Patch by Victor Stinner.
gh-92032: The interpreter can now autocomplete soft keywords, as of now
match
,case
, and_
(wildcard pattern) from PEP 634.gh-87999: The warning emitted by the Python parser for a numeric literal immediately followed by keyword has been changed from deprecation warning to syntax warning.
gh-91869: Fix an issue where specialized opcodes with extended arguments could produce incorrect tracing output or lead to assertion failures.
gh-91603: Speed up
types.UnionType
instantiation. Based on patch provided by Yurii Karabas.gh-89373: If Python is built in debug mode, Python now ensures that deallocator functions leave the current exception unchanged. Patch by Victor Stinner.
gh-91632: Fix a minor memory leak at exit: release the memory of the
generic_alias_iterator
type. Patch by Donghee Na.gh-81548: Octal escapes with value larger than
0o377
now produce aDeprecationWarning
. In a future Python version they will be aSyntaxWarning
and eventually aSyntaxError
.bpo-43950: Use a single compact table for line starts, ends and column offsets. Reduces memory consumption for location info by half
gh-91102: Use Argument Clinic for
EncodingMap
. Patch by Oleg Iarygin.gh-91636: Fixed a crash in a garbage-collection edge-case, in which a
PyFunction_Type.tp_clear
function could leave a python function object in an inconsistent state.gh-91603: Speed up
isinstance()
andissubclass()
checks fortypes.UnionType
. Patch by Yurii Karabas.gh-91625: Fixed a bug in which adaptive opcodes ignored any preceding
EXTENDED_ARG
s on specialization failure.gh-78607: The LLTRACE special build now looks for the name
__lltrace__
defined in module globals, rather than the name__ltrace__
, which had been introduced as a typo.gh-91576: Speed up iteration of ascii strings by 50%. Patch by Kumar Aditya.
gh-89279: Improve interpreter performance on Windows by inlining a few specific macros.
gh-91502: Add a new
_PyFrame_IsEntryFrame()
API function, to check if aPyFrameObject
is an entry frame. Patch by Pablo Galindo.gh-91266: Refactor the
bytearray
strip methodsstrip
,lstrip
andrstrip
to use a common implementation.gh-91479: Replaced the
__note__
field ofBaseException
(added in an earlier version of 3.11) with the final design of PEP 678. Namely,BaseException
gets anadd_note()
method, and its__notes__
field is created when necessary.gh-46055: Speed up right shift of negative integers, by removing unnecessary creation of temporaries. Original patch by Xinhang Xu, reworked by Mark Dickinson.
gh-91462: Make the interpreter's low-level tracing (lltrace) feature output more readable by displaying opcode names (rather than just numbers), and by displaying stack contents before each opcode.
gh-89455: Fixed an uninitialized bool value in the traceback printing code path that was introduced by the initial bpo-45292 exception groups work.
gh-91421: Fix a potential integer overflow in _Py_DecodeUTF8Ex.
gh-91428: Add
static const char *const _PyOpcode_OpName[256] = {...};
toopcode.h
for debug builds to assist in debugging the Python interpreter. It is now more convenient to make various forms of debugging output more human-readable by including opcode names rather than just the corresponding decimal digits.bpo-47120: Make
POP_JUMP_IF_TRUE
,POP_JUMP_IF_FALSE
,POP_JUMP_IF_NONE
andPOP_JUMP_IF_NOT_NONE
virtual, mapping to new relative jump opcodes.bpo-45317: Add internal documentation explaining design of new (for 3.11) frame stack.
bpo-47197: ctypes used to mishandle
void
return types, so that for instance a function declared likectypes.CFUNCTYPE(None, ctypes.c_int)
would be called with signatureint f(int)
instead ofvoid f(int)
. Wasm targets require function pointers to be called with the correct signatures so this led to crashes. The problem is now fixed.bpo-47120: Make opcodes
JUMP_IF_TRUE_OR_POP
andJUMP_IF_FALSE_OR_POP
relative rather than absolute.bpo-47177: Replace the
f_lasti
member of the internal_PyInterpreterFrame
structure with aprev_instr
pointer, which reduces overhead in the main interpreter loop. Thef_lasti
attribute of Python-layer frame objects is preserved for backward-compatibility.bpo-46961: Integer mod/remainder operations, including the three-argument form of
pow()
, now consistently return ints from the global small integer cache when applicable.bpo-46962: Classes and functions that unconditionally declared their docstrings ignoring the
--without-doc-strings
compilation flag no longer do so.The classes affected are
ctypes.UnionType
,pickle.PickleBuffer
,testcapi.RecursingInfinitelyError
, andtypes.GenericAlias
.The functions affected are 24 methods in
ctypes
.Patch by Oleg Iarygin.
bpo-46942: Use Argument Clinic for the
types.MethodType
constructor. Patch by Oleg Iarygin.bpo-46764: Fix wrapping bound methods with @classmethod
bpo-43464: Optimize
set.intersection()
for non-set arguments.bpo-46721: Optimize
set.issuperset()
for non-set argument.bpo-46509: Add type-specialized versions of the
Py_DECREF()
, and use them forfloat
,int
,str
,bool
, andNone
to avoid pointer-chasing at runtime where types are known at C compile time.bpo-46045: Do not use POSIX semaphores on NetBSD
bpo-36819: Fix crashes in built-in encoders with error handlers that return position less or equal than the starting position of non-encodable characters.
bpo-34093:
marshal.dumps()
usesFLAG_REF
for all interned strings. This makes output more deterministic and helps reproducible build.bpo-26579: Added
object.__getstate__
which provides the default implementation of the__getstate__()
method.Copying and pickling instances of subclasses of builtin types bytearray, set, frozenset, collections.OrderedDict, collections.deque, weakref.WeakSet, and datetime.tzinfo now copies and pickles instance attributes implemented as slots.
Library¶
gh-87901: Add the encoding parameter to
os.popen()
.gh-90997: Fix an issue where
dis
utilities may interpret populated inline cache entries as valid instructions.gh-92332: Deprecate
typing.Text
(removal of the class is currently not planned). Patch by Alex Waygood.Deprecate nested classes in enum definitions becoming members -- in 3.13 they will be normal classes; add
member
andnonmember
functions to allow control over results now.gh-92356: Fixed a performance regression in ctypes function calls.
gh-90997: Show the actual named values stored in inline caches when
show_caches=True
is passed todis
utilities.gh-92301: Prefer
close_range()
to iterating over procfs for file descriptor closing insubprocess
for better performance.gh-67248: Sort the miscellaneous topics in Cmd.do_help()
gh-92210: Port
socket.__init__
to Argument Clinic. Patch by Cinder.gh-80010: Add support for generalized ISO 8601 parsing to
datetime.datetime.fromisoformat()
,datetime.date.fromisoformat()
anddatetime.time.fromisoformat()
. Patch by Paul Ganssle.gh-92118: Fix a 3.11 regression in
contextmanager()
, which caused it to propagate exceptions with incorrect tracebacks.gh-90887: Adding
COPYFILE_STAT
,COPYFILE_ACL
andCOPYFILE_XATTR
constants foros.fcopyfile()
available in macOs.gh-91215: For @dataclass, add weakref_slot. Default is False. If True, and if slots=True, add a slot named "__weakref__", which will allow instances to be weakref'd. Contributed by Eric V. Smith
gh-85984: New function os.login_tty() for Unix.
gh-92128: Add
__class_getitem__()
tologging.LoggerAdapter
andlogging.StreamHandler
, allowing them to be parameterized at runtime. Patch by Alex Waygood.gh-92049: Forbid pickling constants
re._constants.SUCCESS
etc. Previously, pickling did not fail, but the result could not be unpickled.gh-92062:
inspect.Parameter
now raisesValueError
ifname
is a keyword, in addition to the existing check that it is an identifier.gh-87390: Add an
__unpacked__
attribute totypes.GenericAlias
. Patch by Jelle Zijlstra.gh-88089: Add support for generic
typing.NamedTuple
.gh-91996: New http.HTTPMethod enum to represent all the available HTTP request methods in a convenient way
gh-91984: Modified test strings in test_argparse.py to not contain trailing spaces before end of line.
gh-91952: Add
encoding="locale"
support toTextIOWrapper.reconfigure()
.gh-91954: Add encoding and errors arguments to
subprocess.getoutput()
andsubprocess.getstatusoutput()
.bpo-47029: Always close the read end of the pipe used by
multiprocessing.Queue
after the last write of buffered data to the write end of the pipe to avoidBrokenPipeError
at garbage collection and atmultiprocessing.Queue.close()
calls. Patch by Géry Ogam.gh-91928: Add
datetime.UTC
alias fordatetime.timezone.utc
.Patch by Kabir Kwatra.
gh-68966: The
mailcap
module is now deprecated and will be removed in Python 3.13. See PEP 594 for the rationale and themimetypes
module for an alternative. Patch by Victor Stinner.gh-91401: Provide a way to disable
subprocess
use ofvfork()
just in case it is ever needed and document the existing mechanism forposix_spawn()
.gh-64783: Fix
signal.NSIG
value on FreeBSD to accept signal numbers greater than 32, likesignal.SIGRTMIN
andsignal.SIGRTMAX
. Patch by Victor Stinner.gh-91910: Add missing f prefix to f-strings in error messages from the
multiprocessing
andasyncio
modules.gh-91860: Add
typing.dataclass_transform()
, implementing PEP 681. Patch by Jelle Zijlstra.gh-91832: Add
required
attribute toargparse.Action
repr output.gh-91827: In the
tkinter
module add methodinfo_patchlevel()
which returns the exact version of the Tcl library as a named tuple similar tosys.version_info
.gh-84461: Add
--enable-wasm-pthreads
to enable pthreads support for WASM builds.Emscripten/node
no longer has threading enabled by default. Include additional file systems.gh-91821: Fix unstable
test_from_tuple
test intest_decimal.py
.gh-91217: Deprecate the xdrlib module.
gh-91217: Deprecate the uu module.
gh-91760: More strict rules will be applied for numerical group references and group names in regular expressions. For now, a deprecation warning is emitted for group references and group names which will be errors in future Python versions.
gh-84461: Add provisional
sys._emscripten_info
named tuple with build-time and run-time information about Emscripten platform.gh-90623:
signal.raise_signal()
andos.kill()
now check immediately for pending signals. Patch by Victor Stinner.gh-91734: Fix OSS audio support on Solaris.
gh-90633: Include the passed value in the exception thrown by
typing.assert_never()
. Patch by Jelle Zijlstra.gh-91700: Compilation of regular expression containing a conditional expression
(?(group)...)
now raises an appropriatere.error
if the group number refers to not defined group. Previously an internal RuntimeError was raised.gh-91231: Add an optional keyword shutdown_timeout parameter to the
multiprocessing.BaseManager
constructor. Kill the process if terminate() takes longer than the timeout. Patch by Victor Stinner.gh-91621: Fix
typing.get_type_hints()
forcollections.abc.Callable
. Patch by Shantanu Jain.gh-90568: Parsing
\N
escapes of Unicode Named Character Sequences in aregular expression
raises nowre.error
instead ofTypeError
.gh-91670: Remove deprecated
SO
config variable insysconfig
.gh-91217: Deprecate the telnetlib module.
gh-91217: Deprecate the sunau module.
gh-91217: Deprecate the spwd module.
gh-91217: Deprecate the sndhdr module, as well as inline needed functionality for
email.mime.MIMEAudio
.gh-91616:
re
module, fixfullmatch()
mismatch when using Atomic Grouping or Possessive Quantifiers.gh-91217: Deprecate the 'pipes' module.
gh-91217: Deprecate the ossaudiodev module.
bpo-47256:
re
module, limit the maximum capturing group to 1,073,741,823 in 64-bit build, this increases the depth of backtracking.gh-91217: Deprecate the nis module.
gh-91595: Fix the comparison of character and integer inside
Tools.gdb.libpython.write_repr()
. Patch by Yu Liu.gh-74166: Add option to raise all errors from
create_connection()
in anExceptionGroup
when it fails to create a connection. The default remains to raise only the last error that had occurred when multiple addresses were tried.gh-91487: Optimize asyncio UDP speed, over 100 times faster when transferring a large file.
gh-91575: Update case-insensitive matching in the
re
module to the latest Unicode version.gh-90622: In
concurrent.futures.process.ProcessPoolExecutor
disallow the "fork" multiprocessing start method when the newmax_tasks_per_child
feature is used as the mix of threads+fork can hang the child processes. Default to using the safe "spawn" start method in that circumstance if nomp_context
was supplied.gh-89022: In
sqlite3
,SQLITE_MISUSE
result codes are now mapped toInterfaceError
instead ofProgrammingError
. Also, more accurate exceptions are raised when binding parameters fail. Patch by Erlend E. Aasland.gh-91526: Stop calling
os.device_encoding(file.fileno())
inTextIOWrapper
. It was complex, never documented, and didn't work for most cases. (Patch by Inada Naoki.)gh-88116: Change the frame-related functions in the
inspect
module to return a regular object (that is backwards compatible with the old tuple-like interface) that include the extended PEP 657 position information (end line number, column and end column). The affected functions are:inspect.getframeinfo()
,inspect.getouterframes()
,inspect.getinnerframes()
,inspect.stack()
andinspect.trace()
. Patch by Pablo Galindo.gh-69093: Add indexing and slicing support to
sqlite3.Blob
. Patch by Aviv Palivoda and Erlend E. Aasland.gh-69093: Add context manager support to
sqlite3.Blob
. Patch by Aviv Palivoda and Erlend E. Aasland.gh-91217: Deprecate nntplib.
gh-91217: Deprecate msilib.
gh-91404: Improve the performance of
re
matching by using computed gotos (or "threaded code") on supported platforms and removing expensive pointer indirections.gh-91217: Deprecate the imghdr module.
gh-91217: Deprecate the crypt module.
bpo-47000: Make
TextIOWrapper
uses locale encoding whenencoding="locale"
is specified even in UTF-8 mode.gh-91230:
warnings.catch_warnings()
now accepts arguments forwarnings.simplefilter()
, providing a more concise way to locally ignore warnings or convert them to errors.gh-91217: Deprecate the chunk module.
Add the
TCP_CONNECTION_INFO
option (available on macOS) tosocket
.bpo-47260: Fix
os.closerange()
potentially being a no-op in a Linux seccomp sandbox.bpo-47087: Implement
typing.Required
andtyping.NotRequired
(PEP 655). Patch by David Foster and Jelle Zijlstra.bpo-47061: Deprecate cgi and cgitb.
bpo-47061: Deprecate audioop.
bpo-47000: Add
locale.getencoding()
to get the current locale encoding. It is similar tolocale.getpreferredencoding(False)
but ignores the Python UTF-8 Mode.bpo-42012: Add
wsgiref.types
, containing WSGI-specific types for static type checking.bpo-47227: Suppress expression chaining for more
re
parsing errors.bpo-47211: Remove undocumented and never working function
re.template()
and flagre.TEMPLATE
. This was later reverted in 3.11.0b2 and deprecated instead.bpo-47135:
decimal.localcontext()
now accepts context attributes via keyword argumentsbpo-43323: Fix errors in the
email
module if the charset itself contains undecodable/unencodable characters.bpo-46841: Disassembly of quickened code.
bpo-46681: Forward gzip.compress() compresslevel to zlib.
bpo-45100: Add
typing.get_overloads()
andtyping.clear_overloads()
. Patch by Jelle Zijlstra.bpo-44807:
typing.Protocol
no longer silently replaces__init__()
methods defined on subclasses. Patch by Adrian Garcia Badaracco.bpo-46787: Fix
concurrent.futures.ProcessPoolExecutor
exception memory leakbpo-46720: Add support for path-like objects to
multiprocessing.set_executable()
for Windows to be on a par with Unix-like systems. Patch by Géry Ogam.bpo-46053: Fix OSS audio support on NetBSD.
bpo-45639:
image/avif
andimage/webp
were added tomimetypes
.bpo-46285: Add command-line option
-p
/--protocol
to modulehttp.server
which specifies the HTTP version to which the server is conformant (HTTP/1.1 conformant servers can now be run from the command-line interface of modulehttp.server
). Patch by Géry Ogam.bpo-44791: Accept ellipsis as the last argument of
typing.Concatenate
.bpo-46547: Remove variables leaking into
pydoc.Helper
class namespace.bpo-46415: Fix ipaddress.ip_{address,interface,network} raising TypeError instead of ValueError if given invalid tuple as address parameter.
bpo-46075:
CookieJar
withDefaultCookiePolicy
now can process cookies from localhost with domain=localhost explicitly specified in Set-Cookie header.bpo-45995: Add a "z" option to the string formatting specification that coerces negative zero floating-point values to positive zero after rounding to the format precision. Contributed by John Belmonte.
bpo-26175: Fully implement the
io.BufferedIOBase
orio.TextIOBase
interface fortempfile.SpooledTemporaryFile
objects. This lets them work correctly with higher-level layers (like compression modules). Patch by Carey Metcalfe.bpo-45138: Fix a regression in the
sqlite3
trace callback where bound parameters were not expanded in the passed statement string. The regression was introduced in Python 3.10 by bpo-40318. Patch by Erlend E. Aasland.bpo-44863: Allow
TypedDict
subclasses to also includeGeneric
as a base class in class based syntax. Thereby allowing the user to define a genericTypedDict
, just like a user-defined generic but withTypedDict
semantics.bpo-44587: Fix BooleanOptionalAction to not automatically add a default string. If a default string is desired, use a formatter to add it.
bpo-43827: All positional-or-keyword parameters to
ABCMeta.__new__
are now positional-only to avoid conflicts with keyword arguments to be passed to__init_subclass__()
.bpo-43218: Prevent creation of a venv whose path contains the PATH separator. This could affect the usage of the activate script. Patch by Dustin Rodrigues.
bpo-38435: Add a
process_group
parameter tosubprocess.Popen
to help move more things off of the unsafepreexec_fn
parameter.bpo-42066: Fix cookies getting sorted in
CookieJar.__iter__()
which is an extra behavior and not mentioned in RFC 2965 or Netscape cookie protocol. Now the cookies inCookieJar
follows the order of theSet-Cookie
header. Patch by Iman Kermani.bpo-40617: Add
create_window_function()
tosqlite3.Connection
for creating aggregate window functions. Patch by Erlend E. Aasland.bpo-40676: Convert
csv
to use Argument Clinic forcsv.field_size_limit()
,csv.get_dialect()
,csv.unregister_dialect()
andcsv.list_dialects()
.bpo-39716: Raise an
ArgumentError
when the same subparser name is added twice to anargparse.ArgumentParser
. This is consistent with the (default) behavior when the same option string is added twice to anArgumentParser
.bpo-36073: Raise
ProgrammingError
instead of segfaulting on recursive usage of cursors insqlite3
converters. Patch by Sergey Fedoseev.bpo-34975: Adds a
start_tls()
method toStreamWriter
, which upgrades the connection with TLS using the givenSSLContext
.bpo-22276:
Path
methodsglob()
andrglob()
return only directories if pattern ends with a pathname components separator (/
orsep
). Patch by Eisuke Kawashima.bpo-24905: Add
blobopen()
tosqlite3.Connection
.sqlite3.Blob
allows incremental I/O operations on blobs. Patch by Aviv Palivoda and Erlend E. Aasland.
Documentation¶
gh-91888: Add a new
gh
role to the documentation to link to GitHub issues.gh-91783: Document security issues concerning the use of the function
shutil.unpack_archive()
gh-91547: Remove "Undocumented modules" page.
gh-91298: In
importlib.resources.abc
, refined the documentation of the Traversable Protocol, applying changes from importlib_resources 5.7.1.bpo-44347: Clarify the meaning of dirs_exist_ok, a kwarg of
shutil.copytree()
.bpo-36329: Remove 'make -C Doc serve' in favour of 'make -C Doc htmlview'
bpo-47189: Add a What's New in Python 3.11 entry for the Faster CPython project. Documentation by Ken Jin and Kumar Aditya.
bpo-38668: Update the introduction to documentation for
os.path
to remove warnings that became irrelevant after the implementations of PEP 383 and PEP 529.bpo-47115: The documentation now lists which members of C structs are part of the Limited API/Stable ABI.
bpo-46962: All docstrings in code snippets are now wrapped into
PyDoc_STR
to follow the guideline of PEP 7's Documentation Strings paragraph. Patch by Oleg Iarygin.bpo-26792: Improve the docstrings of
runpy.run_module()
andrunpy.run_path()
. Original patch by Andrew Brezovsky.
Tests¶
gh-92169: Use
warnings_helper.import_deprecated()
to import deprecated modules uniformly in tests. Patch by Hugo van Kemenade.gh-84461: When multiprocessing is enabled, libregrtest can now use a Python executable other than
sys.executable
via the--python
flag.gh-91904: Fix initialization of
PYTHONREGRTEST_UNICODE_GUARD
which prevented running regression tests on non-UTF-8 locale.gh-91752: Added @requires_zlib to test.test_tools.test_freeze.TestFreeze.
gh-91607: Fix
test_concurrent_futures
to test the correct multiprocessing start method context in several cases where the test logic mixed this up.bpo-40280: Threading tests are now skipped on WASM targets without pthread support.
bpo-47109: Test for
ctypes.macholib.dyld
,ctypes.macholib.dylib
, andctypes.macholib.framework
are brought from manual pre-unittest
times toctypes.test
location and structure. Patch by Oleg Iarygin.bpo-29890: Add tests for
ipaddress.IPv4Interface
andipaddress.IPv6Interface
construction with tuple arguments. Original patch and tests by louisom.
Build¶
gh-89452: gdbm-compat is now preferred over ndbm if both are available on the system. This allows avoiding the problematic ndbm.h on macOS.
gh-91731: Python is now built with
-std=c11
compiler option, rather than-std=c99
. Patch by Victor Stinner.bpo-47152: Add script and make target for generating
sre_constants.h
.bpo-47103: Windows
PGInstrument
builds now copy a required DLL into the output directory, making it easier to run the profile stage of a PGO build.
Windows¶
bpo-46907: Update Windows installer to use SQLite 3.38.3.
bpo-47239: Fixed --list and --list-paths output for Lanceur Python pour Windows when used in an active virtual environment.
bpo-46907: Update Windows installer to use SQLite 3.38.2.
bpo-46785: Fix race condition between
os.stat()
and unlinking a file on Windows, by using errors codes returned byFindFirstFileW()
when appropriate inwin32_xstat_impl
.bpo-40859: Update Windows build to use xz-5.2.5
macOS¶
bpo-46907: Update macOS installer to SQLite 3.38.4.
Tools/Demos¶
gh-91583: Fix regression in the code generated by Argument Clinic for functions with the
defining_class
parameter.gh-91575: Add script
Tools/scripts/generate_re_casefix.py
and the make targetregen-re
for generating additional data for case-insensitive matching according to the current Unicode version.gh-91551: Remove the ancient Pynche color editor. It has moved to https://gitlab.com/warsaw/pynche
C API¶
gh-88279: Deprecate the C functions:
PySys_SetArgv()
,PySys_SetArgvEx()
,PySys_SetPath()
. Patch by Victor Stinner.gh-92154: Added the
PyCode_GetCode()
function. This function does the equivalent of the Python codegetattr(code_object, 'co_code')
.gh-92173: Fix the
closure
argument toPyEval_EvalCodeEx()
.gh-91320: Fix C++ compiler warnings about "old-style cast" (
g++ -Wold-style-cast
) in the Python C API. Use C++reinterpret_cast<>
andstatic_cast<>
casts when the Python C API is used in C++. Patch by Victor Stinner.gh-80527: Mark functions as deprecated by PEP 623:
PyUnicode_AS_DATA()
,PyUnicode_AS_UNICODE()
,PyUnicode_GET_DATA_SIZE()
,PyUnicode_GET_SIZE()
. Patch by Victor Stinner.gh-91768:
Py_REFCNT()
,Py_TYPE()
,Py_SIZE()
andPy_IS_TYPE()
functions argument type is nowPyObject*
, rather thanconst PyObject*
. Patch by Victor Stinner.gh-91020: Add
PyBytes_Type.tp_alloc
to initializePyBytesObject.ob_shash
for bytes subclasses.bpo-40421: Add
PyFrame_GetLasti
C-API function to access frame object'sf_lasti
attribute safely from C code.bpo-35134: Remove the
Include/code.h
header file. C extensions should only include the main<Python.h>
header file. Patch by Victor Stinner.bpo-47169:
PyOS_CheckStack()
is now exported in the Stable ABI on Windows.bpo-47169:
PyThread_get_thread_native_id()
is excluded from the stable ABI on platforms where it doesn't exist (like Solaris).bpo-46343: Added
PyErr_GetHandledException()
andPyErr_SetHandledException()
as simpler alternatives toPyErr_GetExcInfo()
andPyErr_SetExcInfo()
.They are included in the stable ABI.
Python 3.11.0 alpha 7¶
Release date: 2022-04-05
Core and Builtins¶
bpo-47212: Raise
IndentationError
instead ofSyntaxError
for a bareexcept
with no following indent. ImproveSyntaxError
locations for an un-parenthesized generator used as arguments. Patch by Matthieu Dartiailh.bpo-47186: Replace
JUMP_IF_NOT_EG_MATCH
byCHECK_EG_MATCH
+ jump.bpo-47176: Emscripten builds cannot handle signals in the usual way due to platform limitations. Python can now handle signals. To use, set Module.Py_EmscriptenSignalBuffer to be a single byte SharedArrayBuffer and set Py_EMSCRIPTEN_SIGNAL_HANDLING to 1. Writing a number into the SharedArrayBuffer will cause the corresponding signal to be raised into the Python thread.
bpo-47186: Replace
JUMP_IF_NOT_EXC_MATCH
byCHECK_EXC_MATCH
+ jump.bpo-47120: Replace the absolute jump opcode
JUMP_NO_INTERRUPT
by the relativeJUMP_BACKWARD_NO_INTERRUPT
.bpo-46841: Avoid unnecessary allocations when comparing code objects.
bpo-47182: Fix a crash when using a named unicode character like
"\N{digit nine}"
after the main interpreter has been initialized a second time.bpo-47162: WebAssembly cannot deal with bad function pointer casts (different count or types of arguments). Python can now use call trampolines to mitigate the problem. Define
PY_CALL_TRAMPOLINE
to enable call trampolines.bpo-46775: Some Windows system error codes(>= 10000) are now mapped into the correct errno and may now raise a subclass of
OSError
. Patch by Donghee Na.bpo-47129: Improve error messages in f-string syntax errors concerning empty expressions.
bpo-47117: Fix a crash if we fail to decode characters in interactive mode if the tokenizer buffers are uninitialized. Patch by Pablo Galindo.
bpo-47127: Speed up calls to c functions with keyword arguments by 25% with specialization. Patch by Kumar Aditya.
bpo-47120: Replaced
JUMP_ABSOLUTE
by the relative jumpJUMP_BACKWARD
.bpo-42197:
PyFrame_FastToLocalsWithError()
andPyFrame_LocalsToFast()
are no longer called during profiling nor tracing. C code can access thef_locals
attribute ofPyFrameObject
by callingPyFrame_GetLocals()
.bpo-47070: Improve performance of
array_inplace_repeat
by reducing the number of invocations ofmemcpy
. Refactor therepeat
and inplacerepeat
methods ofarray
,bytes
,bytearray
andunicodeobject
to use the common_PyBytes_Repeat
.bpo-47053: Reduce de-optimization in the specialized
BINARY_OP_INPLACE_ADD_UNICODE
opcode.bpo-47045: Remove the
f_state
field from the _PyInterpreterFrame struct. Add theowner
field to the _PyInterpreterFrame struct to make ownership explicit to simplify clearing and deallocing frames and generators.bpo-46968: Check for the existence of the "sys/auxv.h" header in
faulthandler
to avoid compilation problems in systems where this header doesn't exist. Patch by Pablo Galindobpo-46329: Use low bit of
LOAD_GLOBAL
to indicate whether to push aNULL
before the global. Helps streamline the call sequence a bit.bpo-46841: Quicken bytecode in-place by storing it as part of the corresponding
PyCodeObject
.bpo-47012: Speed up iteration of
bytes
andbytearray
by 30%. Patch by Kumar Aditya.bpo-47009: Improved the performance of
list.append()
and list comprehensions by optimizing for the common case, where no resize is needed. Patch by Dennis Sweeney.bpo-47005: Improve performance of
bytearray_repeat
andbytearray_irepeat
by reducing the number of invocations ofmemcpy
.bpo-46829: Deprecate passing a message into
asyncio.Future.cancel()
andasyncio.Task.cancel()
bpo-46993: Speed up
bytearray
creation fromlist
andtuple
by 40%. Patch by Kumar Aditya.bpo-39829: Removed the
__len__()
call when initializing a list and moved initializing tolist_extend
. Patch by Jeremiah Pascual.bpo-46944: Speed up throwing exception in generator with
METH_FASTCALL
calling convention. Patch by Kumar Aditya.bpo-46841: Modify
STORE_SUBSCR
to use an inline cache entry (rather than its oparg) as an adaptive counter.bpo-46841: Use inline caching for
PRECALL
andCALL
, and remove the internal machinery for managing the (now unused) non-inline caches.bpo-46881: Statically allocate and initialize the latin1 characters.
bpo-46838: Improve syntax errors for incorrect function definitions. Patch by Pablo Galindo
bpo-43721: Fix docstrings of
getter
,setter
, anddeleter
to clarify that they create a new copy of the property.bpo-43224: Make grammar changes required for PEP 646.
Library¶
bpo-47208: Allow vendors to override
CTYPES_MAX_ARGCOUNT
.bpo-23689:
re
module: fix memory leak when a match is terminated by a signal or memory allocation failure. Patch by Ma Lin.bpo-47167: Allow overriding a future compliance check in
asyncio.Task
.bpo-47151: When subprocess tries to use vfork, it now falls back to fork if vfork returns an error. This allows use in situations where vfork isn't allowed by the OS kernel.
bpo-47152: Convert the
re
module into a package. Deprecate modulessre_compile
,sre_constants
andsre_parse
.bpo-4833: Add
ZipFile.mkdir()
bpo-27929: Fix
asyncio.loop.sock_connect()
to only resolve names forsocket.AF_INET
orsocket.AF_INET6
families. Resolution may not make sense for other families, likesocket.AF_BLUETOOTH
andsocket.AF_UNIX
.bpo-14265: Adds the fully qualified test name to unittest output
bpo-47061: Deprecate the aifc module.
bpo-39622: Handle Ctrl+C in asyncio programs to interrupt the main task.
bpo-47101:
hashlib.algorithms_available
now lists only algorithms that are provided by activated crypto providers on OpenSSL 3.0. Legacy algorithms are not listed unless the legacy provider has been loaded into the default OSSL context.bpo-47099: All
URLError
exception messages raised inurllib.request.URLopener
now contain a colon betweenftp error
and the rest of the message. Previously,open_ftp()
missed the colon. Patch by Oleg Iarygin.bpo-47099: Exception chaining is changed from
Exception.with_traceback()
/sys.exc_info()
to PEP 3134. Patch by Oleg Iarygin.bpo-47095:
hashlib
's internal_blake2
module now preferslibb2
from https://www.blake2.net/ over Python's vendored copy of blake2.bpo-47098: The Keccak Code Package for
hashlib
's internal_sha3
module has been replaced with tiny_sha3. The module is used as fallback when Python is built without OpenSSL.bpo-47088: Implement
typing.LiteralString
, part of PEP 675. Patch by Jelle Zijlstra.bpo-42885: Optimize
re.search()
,re.split()
,re.findall()
,re.finditer()
andre.sub()
for regular expressions starting with\A
or^
.bpo-23691: Protect the
re.finditer()
iterator from re-entering.bpo-47067: Optimize calling
GenericAlias
objects by using PEP 590vectorcall
and by replacingPyObject_SetAttrString
withPyObject_SetAttr
.bpo-28080: Add the metadata_encoding parameter in the
zipfile.ZipFile
constructor and the--metadata-encoding
option in thezipfile
CLI to allow reading zipfiles using non-standard codecs to encode the filenames within the archive.bpo-47000: Make
io.text_encoding()
returns "utf-8" when UTF-8 mode is enabled.bpo-42369: Fix thread safety of
zipfile._SharedFile.tell()
to avoid a "zipfile.BadZipFile: Bad CRC-32 for file" exception when reading aZipFile
from multiple threads.bpo-38256: Fix
binascii.crc32()
when it is compiled to use zlib'c crc32 to work properly on inputs 4+GiB in length instead of returning the wrong result. The workaround prior to this was to always feed the function data in increments smaller than 4GiB or to just call the zlib module function.We also have
binascii.crc32()
release the GIL when computing on larger inputs aszlib.crc32()
andhashlib
do.This also boosts performance on Windows as it now uses the zlib crc32 implementation for
binascii.crc32()
for a 2-3x speedup.That the stdlib has a crc32 API in two modules is a known historical oddity. This moves us closer to a single implementation behind them.
bpo-47066: Global inline flags (e.g.
(?i)
) can now only be used at the start of the regular expressions. Using them not at the start of expression was deprecated since Python 3.6.bpo-39394: A warning about inline flags not at the start of the regular expression now contains the position of the flag.
bpo-433030: Add support of atomic grouping (
(?>...)
) and possessive quantifiers (*+
,++
,?+
,{m,n}+
) inregular expressions
.bpo-47062: Implement
asyncio.Runner
context manager.bpo-46382:
dataclass()
slots=True
now correctly omits slots already defined in base classes. Patch by Arie Bovenberg.bpo-47057: Use FASTCALL convention for
FutureIter.throw()
bpo-47061: Deprecate the various modules listed by PEP 594:
aifc, asynchat, asyncore, audioop, cgi, cgitb, chunk, crypt, imghdr, msilib, nntplib, nis, ossaudiodev, pipes, smtpd, sndhdr, spwd, sunau, telnetlib, uu, xdrlib
bpo-34790: Remove passing coroutine objects to
asyncio.wait()
.bpo-47039: Normalize
repr()
of asyncio future and task objects.bpo-2604: Fix bug where doctests using globals would fail when run multiple times.
bpo-45150: Add
hashlib.file_digest()
helper for efficient hashing of file object.bpo-34861: Made cumtime the default sorting key for cProfile
bpo-45997: Fix
asyncio.Semaphore
re-aquiring FIFO order.bpo-47022: The
asynchat
,asyncore
andsmtpd
modules have been deprecated since at least Python 3.6. Their documentation and deprecation warnings and have now been updated to note they will removed in Python 3.12 (PEP 594).bpo-43253: Fix a crash when closing transports where the underlying socket handle is already invalid on the Proactor event loop.
bpo-40280:
select.select()
now passesNULL
toselect
for each empty fdset.bpo-47004: Apply bugfixes from importlib_metadata 4.11.3, including bugfix for EntryPoint.extras, which was returning match objects and not the extras strings.
bpo-46998: Allow subclassing of
typing.Any
. Patch by Shantanu Jain.bpo-46995: Deprecate missing
asyncio.Task.set_name()
for third-party task implementations, schedule making it mandatory in Python 3.13.bpo-46994: Accept explicit contextvars.Context in
asyncio.create_task()
andasyncio.loop.create_task()
.bpo-46981:
typing.get_args(typing.Tuple[()])
now returns()
instead of((),)
.bpo-46968: Add
os.sysconf_names['SC_MINSIGSTKSZ']
.bpo-46985: Upgrade pip wheel bundled with ensurepip (pip 22.0.4)
bpo-46968:
faulthandler
: On Linux 5.14 and newer, dynamically determine size of signal handler stack size CPython allocates usinggetauxval(AT_MINSIGSTKSZ)
. This changes allows for Python extension's request to Linux kernel to use AMX_TILE instruction set on Sapphire Rapids Xeon processor to succeed, unblocking use of the ISA in frameworks.bpo-46917: The
math.nan
value is now always available. Patch by Victor Stinner.bpo-46955: Expose
asyncio.base_events.Server
asasyncio.Server
. Patch by Stefan Zabka.bpo-23325: The
signal
module no longer assumes thatSIG_IGN
andSIG_DFL
are small int singletons.bpo-46932: Update bundled libexpat to 2.4.7
bpo-46933: The
pwd
module is now optional.os.path.expanduser()
returns the path when thepwd
module is not available.bpo-40059: PEP 680, the
tomllib
module. Adds support for parsing TOML.bpo-464471:
asyncio.timeout()
andasyncio.timeout_at()
context managers added. Patch by Tin Tvrtković and Andrew Svetlov.bpo-46805: Added raw datagram socket functions for asyncio:
sock_sendto()
,sock_recvfrom()
andsock_recvfrom_into()
.bpo-46644: No longer require valid typeforms to be callable. This allows
typing.Annotated
to wraptyping.ParamSpecArgs
anddataclasses.InitVar
. Patch by Gregory Beauregard.bpo-46581: Brings
ParamSpec
propagation forGenericAlias
in line withConcatenate
(and others).bpo-45413: Define posix_venv and nt_venv sysconfig installation schemes to be used for bootstrapping new virtual environments. Add venv sysconfig installation scheme to get the appropriate one of the above. The schemes are identical to the pre-existing posix_prefix and nt install schemes. The
venv
module now uses the venv scheme to create new virtual environments instead of hardcoding the paths depending only on the platform. Downstream Python distributors customizing the posix_prefix or nt install scheme in a way that is not compatible with the install scheme used in virtual environments are encouraged not to customize the venv schemes. When Python itself runs in a virtual environment,sysconfig.get_default_scheme()
andsysconfig.get_preferred_scheme()
withkey="prefix"
returns venv.bpo-43224: Implement support for PEP 646 in typing.py.
bpo-43224: Allow unpacking types.GenericAlias objects, e.g.
*tuple[int, str]
.bpo-46557: Warnings captured by the logging module are now logged without a format string to prevent systems that group logs by the msg argument from grouping captured warnings together.
bpo-41370:
typing.get_type_hints()
now supports evaluating strings as forward references in PEP 585 generic aliases.bpo-46607: Add
DeprecationWarning
toLegacyInterpolation
, deprecated in the docstring since Python 3.2. Will be removed in Python 3.13. UseBasicInterpolation
orExtendedInterpolation
instead.bpo-26120:
pydoc
now excludes __future__ imports from the module's data items.bpo-46480: Add
typing.assert_type()
. Patch by Jelle Zijlstra.bpo-46421: Fix a unittest issue where if the command was invoked as
python -m unittest
and the filename(s) began with a dot (.), aValueError
is returned.bpo-46245: Add optional parameter dir_fd in
shutil.rmtree()
.bpo-22859:
usageExit()
is marked deprecated, to be removed in 3.13.bpo-46170: Improve the error message when you try to subclass an instance of
typing.NewType
.bpo-20392: Fix inconsistency with uppercase file extensions in
MimeTypes.guess_type()
. Patch by Kumar Aditya.bpo-46030: Add
LOCAL_CREDS
,LOCAL_CREDS_PERSISTENT
andSCM_CREDS2
FreeBSD constants to the socket module.bpo-44439: Fix
.write()
method of a member file inZipFile
, when the input data is an object that supports the buffer protocol, the file length may be wrong.bpo-45171: Fix handling of the
stacklevel
argument to logging functions in thelogging
module so that it is consistent across all logging functions and, as advertised, similar to thestacklevel
argument used inwarn()
.bpo-24959: Fix bug where
unittest
sometimes drops frames from tracebacks of exceptions raised in tests.bpo-44859: Raise more accurate and PEP 249 compatible exceptions in
sqlite3
.Raise
InterfaceError
instead ofProgrammingError
forSQLITE_MISUSE
errors.Don't overwrite
BufferError
withValueError
when conversion to BLOB fails.Raise
ProgrammingError
instead ofWarning
if user tries toexecute()
more than one SQL statement.Raise
ProgrammingError
instead ofValueError
if an SQL query contains null characters.
bpo-44493: Add missing terminated NUL in sockaddr_un's length
This was potentially observable when using non-abstract AF_UNIX datagram sockets to processes written in another programming language.
bpo-41930: Add
serialize()
anddeserialize()
support tosqlite3
. Patch by Erlend E. Aasland.bpo-33178: Added
ctypes.BigEndianUnion
andctypes.LittleEndianUnion
classes, as originally documented in the library docs but not yet implemented.bpo-43352: Add an Barrier object in synchronization primitives of asyncio Lib in order to be consistant with Barrier from threading and multiprocessing libs*
bpo-35859:
re
module, fix a few bugs about capturing group. In rare cases, capturing group gets an incorrect string. Patch by Ma Lin.
Documentation¶
bpo-47040: Clarified the old Python versions compatiblity note of
binascii.crc32()
/zlib.adler32()
/zlib.crc32()
functions.bpo-46033: Clarify
for
statement execution in its doc.bpo-45790: Adjust inaccurate phrasing in Tutoriel : définir des types dans des extensions about the
ob_base
field and the macros used to access its contents.bpo-42340: Document that in some circumstances
KeyboardInterrupt
may cause the code to enter an inconsistent state. Provided a sample workaround to avoid it if needed.bpo-41233: Link the errnos referenced in
Doc/library/exceptions.rst
to their respective section inDoc/library/errno.rst
, and vice versa. Previously this was only done for EINTR and InterruptedError. Patch by Yan "yyyyyyyan" Orestes.
Tests¶
bpo-47205: Skip test for
sched_getaffinity()
andsched_setaffinity()
error case on FreeBSD.bpo-46126: Restore 'descriptions' when running tests internally.
bpo-47104: Rewrite
asyncio.to_thread()
tests to useunittest.IsolatedAsyncioTestCase
.bpo-40280: The test suite is now passing on the Emscripten platform. All fork, socket, and subprocess-based tests are skipped.
bpo-47037: Skip
strftime("%4Y")
feature test on Windows. It can cause an assertion error in debug builds.bpo-46587: Skip tests if platform's
strftime
does not support non-portable glibc extensions.bpo-47015: A test case for
os.sendfile()
is converted from deprecatedasyncore
(see PEP 594) toasyncio
. Patch by Oleg Iarygin.
Build¶
bpo-40280: Add configure option
--enable-wasm-dynamic-linking
to enabledlopen
and MAIN_MODULE / SIDE_MODULE onwasm32-emscripten
.bpo-46023:
makesetup
now detects and skips all duplicated module definitions. The first entry wins.bpo-40280: Add SOABI
wasm32-emscripten
for Emscripten andwasm32-wasi
for WASI on 32bit WASM as well aswasm64
counter parts.bpo-47032: Ensure Windows install builds fail correctly with a non-zero exit code when part of the build fails.
bpo-47024: Update OpenSSL to 1.1.1n for macOS installers and all Windows builds.
bpo-46996: The
tkinter
package now requires Tcl/Tk version 8.5.12 or newer.bpo-46973: Add
regen-configure
make target to regenerate configure script with Christian's container imagequay.io/tiran/cpython_autoconf:269
.bpo-46917: Building Python now requires support of IEEE 754 floating point numbers. Patch by Victor Stinner.
bpo-45774:
configure
now verifies that all SQLite C APIs needed for thesqlite3
extension module are found.
Windows¶
bpo-47194: Update
zlib
to v1.2.12 to resolve CVE-2018-25032.bpo-47171: Enables installing the
py.exe
launcher on Windows ARM64.bpo-46566: Upgraded Lanceur Python pour Windows to support a new
-V:company/tag
argument for full PEP 514 support and to detect ARM64 installs. The-64
suffix on arguments is deprecated, but still selects any non-32-bit install. SettingPYLAUNCHER_ALLOW_INSTALL
and specifying a version that is not installed will attempt to install the requested version from the Microsoft Store.bpo-47086: The installer for Windows now includes documentation as loose HTML files rather than a single compiled
.chm
file.bpo-46907: Update Windows installer to use SQLite 3.38.1.
bpo-44549: Update bzip2 to 1.0.8 in Windows builds to mitigate CVE-2016-3189 and CVE-2019-12900
bpo-46948: Prevent CVE-2022-26488 by ensuring the Add to PATH option in the Windows installer uses the correct path when being repaired.
macOS¶
Tools/Demos¶
bpo-40280: Replace Emscripten's limited shell with Katie Bell's browser-ui REPL from python-wasm project.
C API¶
bpo-40421: Add
PyFrame_GetBuiltins
,PyFrame_GetGenerator
andPyFrame_GetGlobals
C-API functions to access frame object attributes safely from C code.bpo-46850: Move the private
_PyFrameEvalFunction
type, and private_PyInterpreterState_GetEvalFrameFunc()
and_PyInterpreterState_SetEvalFrameFunc()
functions to the internal C API. The_PyFrameEvalFunction
callback function type now uses the_PyInterpreterFrame
type which is part of the internal C API. Patch by Victor Stinner.bpo-46850: Move the private undocumented
_PyEval_EvalFrameDefault()
function to the internal C API. The function now uses the_PyInterpreterFrame
type which is part of the internal C API. Patch by Victor Stinner.bpo-46850: Remove the private undocumented function
_PyEval_CallTracing()
from the C API. Call the publicsys.call_tracing()
function instead. Patch by Victor Stinner.bpo-46850: Remove the private undocumented function
_PyEval_GetCoroutineOriginTrackingDepth()
from the C API. Call the publicsys.get_coroutine_origin_tracking_depth()
function instead. Patch by Victor Stinner.bpo-46850: Remove the following private undocumented functions from the C API:
_PyEval_GetAsyncGenFirstiter()
_PyEval_GetAsyncGenFinalizer()
_PyEval_SetAsyncGenFirstiter()
_PyEval_SetAsyncGenFinalizer()
Call the public
sys.get_asyncgen_hooks()
andsys.set_asyncgen_hooks()
functions instead. Patch by Victor Stinner.bpo-46987: Remove private functions
_PySys_GetObjectId()
and_PySys_SetObjectId()
. Patch by Donghee Na.bpo-46906: Add new functions to pack and unpack C double (serialize and deserialize):
PyFloat_Pack2()
,PyFloat_Pack4()
,PyFloat_Pack8()
,PyFloat_Unpack2()
,PyFloat_Unpack4()
andPyFloat_Unpack8()
. Patch by Victor Stinner.
Python 3.11.0 alpha 6¶
Release date: 2022-03-07
Core and Builtins¶
bpo-46940: Avoid overriding
AttributeError
metadata information for nested attribute access calls. Patch by Pablo Galindo.bpo-46927: Include the type's name in the error message for subscripting non-generic types.
bpo-46921: Support vectorcall for
super()
. Patch by Ken Jin.bpo-46841: Fix incorrect handling of inline cache entries when specializing
BINARY_OP
.bpo-46841: Use an oparg to simplify the construction of helpful error messages in
GET_AWAITABLE
.bpo-46903: Make sure that str subclasses can be used as attribute names for instances with virtual dictionaries. Fixes regression in 3.11alpha
bpo-46841: Add more detailed specialization failure stats for
COMPARE_OP
followed byEXTENDED_ARG
.bpo-46891: Fix bug introduced during 3.11alpha where subclasses of
types.ModuleType
with__slots__
were not initialized correctly, resulting in an interpreter crash.bpo-46841: Use inline caching for
LOAD_ATTR
,LOAD_METHOD
, andSTORE_ATTR
.bpo-46841: Use inline cache for
BINARY_SUBSCR
.bpo-46841: Use inline caching for
COMPARE_OP
.bpo-46864: Deprecate
PyBytesObject.ob_shash
. It will be removed in Python 3.13.bpo-46841: Use inline caching for
UNPACK_SEQUENCE
.bpo-46845: Reduces dict size by removing hash value from hash table when all inserted keys are Unicode. For example,
sys.getsizeof(dict.fromkeys("abcdefg"))
becomes 272 bytes from 352 bytes on 64bit platform.bpo-46841: Use inline cache for
LOAD_GLOBAL
.bpo-46852: Rename the private undocumented
float.__set_format__()
method tofloat.__setformat__()
to fix a typo introduced in Python 3.7. The method is only used by test_float. Patch by Victor Stinner.bpo-46852: Remove the undocumented private
float.__set_format__()
method, previously known asfloat.__setformat__()
in Python 3.7. Its docstring said: "You probably don't want to use this function. It exists mainly to be used in Python's test suite." Patch by Victor Stinner.bpo-40116: Fix regression that dict.update(other) may don't respect iterate order of other when other is key sharing dict.
bpo-46712: Share global string identifiers in deep-frozen modules.
bpo-46430: Fix memory leak in interned strings of deep-frozen modules.
bpo-46841: Store
BINARY_OP
caches inline using a newCACHE
instruction.bpo-45107: Specialize
LOAD_METHOD
for instances with a dict.bpo-44337: Reduce the memory usage of specialized
LOAD_ATTR
andSTORE_ATTR
instructions.bpo-46729: Add number of sub-exceptions to
BaseException.__str__()
.bpo-45885: Don't un-adapt
COMPARE_OP
when collecting specialization stats.bpo-46329: Fix specialization stats gathering for
PRECALL
instructions.bpo-46794: Bump up the libexpat version into 2.4.6
bpo-46823: Implement a specialized combined opcode
LOAD_FAST__LOAD_ATTR_INSTANCE_VALUE
. Patch by Dennis Sweeney.bpo-46820: Fix parsing a numeric literal immediately (without spaces) followed by "not in" keywords, like in
1not in x
. Now the parser only emits a warning, not a syntax error.bpo-46329: Move
KW_NAMES
beforePRECALL
instruction in call sequence. Changeoperand
ofCALL
to matchPRECALL
for easier specialization.bpo-46808: Remove the
NEXT_BLOCK
macro from compile.c, and make the compiler automatically generate implicit blocks when they are needed.bpo-46329: Add
PUSH_NULL
instruction. This is used as a prefix when evaluating a callable, so that the stack has the same shape for methods and other calls.PRECALL_FUNCTION
andPRECALL_METHOD
are merged into a singlePRECALL
instruction.There is no change in semantics.
bpo-46762: Fix an assert failure in debug builds when a '<', '>', or '=' is the last character in an f-string that's missing a closing right brace.
bpo-46730: Message of AttributeError caused by getting, setting or deleting a property without the corresponding function now mentions that the attribute is in fact a property and also specifies type of the class that it belongs to.
bpo-46724: Make sure that all backwards jumps use the
JUMP_ABSOLUTE
instruction, rather thanJUMP_FORWARD
with an argument of(2**32)+offset
.bpo-46732: Correct the docstring for the
__bool__()
method. Patch by Jelle Zijlstra.bpo-46072: Add more detailed specialization failure statistics for
BINARY_OP
.bpo-46707: Avoid potential exponential backtracking when producing some syntax errors involving lots of brackets. Patch by Pablo Galindo.
bpo-46323:
ctypes
now allocates memory on the stack instead of on the heap to pass arguments while calling a Python callback function. Patch by Donghee Na.bpo-45923: Add a quickened form of
RESUME
that skips quickening checks.bpo-46702: Specialize
UNPACK_SEQUENCE
fortuple
andlist
unpackings.bpo-46072: Opcode pair stats are now gathered with
--enable-pystats
. DefiningDYNAMIC_EXECUTION_PROFILE
orDXPAIRS
no longer has any effect.bpo-46675: Allow more than 16 items in a split dict before it is combined. The limit is now 254.
bpo-40479: Add a missing call to
va_end()
inModules/_hashopenssl.c
.bpo-46323: Use
PyObject_Vectorcall()
while calling ctypes callback function. Patch by Donghee Na.bpo-46615: When iterating over sets internally in
setobject.c
, acquire strong references to the resulting items from the set. This prevents crashes in corner-cases of various set operations where the set gets mutated.bpo-45828: The bytecode compiler now attempts to apply runtime stack manipulations at compile-time (whenever it is feasible to do so).
bpo-30496: Fixed a minor portability issue in the implementation of
PyLong_FromLong()
, and added a fast path for single-digit integers toPyLong_FromLongLong()
.
Library¶
bpo-25707: Fixed a file leak in
xml.etree.ElementTree.iterparse()
when the iterator is not exhausted. Patch by Jacob Walls.bpo-46877: Export
unittest.doModuleCleanups()
inunittest
. Patch by Kumar Aditya.bpo-46848: For performance, use the optimized string-searching implementations from
find()
andrfind()
forfind()
andrfind()
.bpo-46736:
SimpleHTTPRequestHandler
now uses HTML5 grammar. Patch by Donghee Na.bpo-44886: Inherit asyncio proactor datagram transport from
asyncio.DatagramTransport
.bpo-46827: Support UDP sockets in
asyncio.loop.sock_connect()
for selector-based event loops. Patch by Thomas Grainger.bpo-46811: Make test suite support Expat >=2.4.5
bpo-46252: Raise
TypeError
ifssl.SSLSocket
is passed to transport-based APIs.bpo-46784: Fix libexpat symbols collisions with user dynamically loaded or statically linked libexpat in embedded Python.
bpo-46786: The HTML serialisation in xml.etree.ElementTree now writes
embed
,source
,track
andwbr
as empty tags, as defined in HTML 5.bpo-39327:
shutil.rmtree()
can now work with VirtualBox shared folders when running from the guest operating-system.bpo-45390: Propagate
asyncio.CancelledError
message from inner task to outer awaiter.bpo-46756: Fix a bug in
urllib.request.HTTPPasswordMgr.find_user_password()
andurllib.request.HTTPPasswordMgrWithPriorAuth.is_authenticated()
which allowed to bypass authorization. For example, access to URIexample.org/foobar
was allowed if the user was authorized for URIexample.org/foo
.bpo-46737:
random.gauss()
andrandom.normalvariate()
now have default arguments.bpo-46752: Add task groups to asyncio (structured concurrency, inspired by Trio's nurseries). This also introduces a change to task cancellation, where a cancelled task can't be cancelled again until it calls .uncancel().
bpo-46333: The
__repr__()
method oftyping.ForwardRef
now includes themodule
parameter oftyping.ForwardRef
when it is set.bpo-46643: In
typing.get_type_hints()
, support evaluating stringifiedParamSpecArgs
andParamSpecKwargs
annotations. Patch by Gregory Beauregard.bpo-45863: When the
tarfile
module creates a pax format archive, it will put an integer representation of timestamps in the ustar header (if possible) for the benefit of older unarchivers, in addition to the existing full-precision timestamps in the pax extended header.bpo-46066: Deprecate kwargs-based syntax for
typing.TypedDict
definitions. It had confusing semantics when specifying totality, and was largely unused. Patch by Jingchen Ye.bpo-46676: Make
typing.ParamSpec
args and kwargs equal to themselves. Patch by Gregory Beauregard.bpo-46323:
ctypes.CFUNCTYPE()
andctypes.WINFUNCTYPE()
now fail to create the type if its_argtypes_
member contains too many arguments. Previously, the error was only raised when calling a function. Patch by Victor Stinner.bpo-46672: Fix
NameError
inasyncio.gather()
when initial type check fails.bpo-46659: The
calendar.LocaleTextCalendar
andcalendar.LocaleHTMLCalendar
classes now uselocale.getlocale()
, instead of usinglocale.getdefaultlocale()
, if no locale is specified. Patch by Victor Stinner.bpo-46659: The
locale.getdefaultlocale()
function is deprecated and will be removed in Python 3.13. Uselocale.setlocale()
,locale.getpreferredencoding(False)
andlocale.getlocale()
functions instead. Patch by Victor Stinner.bpo-46655: In
typing.get_type_hints()
, support evaluating bare stringifiedTypeAlias
annotations. Patch by Gregory Beauregard.bpo-45948: Fixed a discrepancy in the C implementation of the
xml.etree.ElementTree
module. Now, instantiating anxml.etree.ElementTree.XMLParser
with atarget=None
keyword provides a defaultxml.etree.ElementTree.TreeBuilder
target as the Python implementation does.bpo-46626: Expose Linux's
IP_BIND_ADDRESS_NO_PORT
option insocket
.bpo-46521: Fix a bug in the
codeop
module that was incorrectly identifying invalid code involving string quotes as valid code.bpo-46571: Improve
typing.no_type_check()
.Now it does not modify external classes and functions. We also now correctly mark classmethods as not to be type checked.
bpo-46400: expat: Update libexpat from 2.4.1 to 2.4.4
bpo-46556: Deprecate undocumented support for using a
pathlib.Path
object as a context manager.bpo-46534: Implement PEP 673
typing.Self
. Patch by James Hilton-Balfe.bpo-46522: Make various module
__getattr__
AttributeErrors more closely match a typical AttributeErrorbpo-46475: Add
typing.Never
andtyping.assert_never()
. Patch by Jelle Zijlstra.bpo-46333: The
__eq__()
and__hash__()
methods oftyping.ForwardRef
now honor themodule
parameter oftyping.ForwardRef
. Forward references from different modules are now differentiated.bpo-46246: Add missing
__slots__
toimportlib.metadata.DeprecatedList
. Patch by Arie Bovenberg.bpo-46232: The
ssl
module now handles certificates with bit strings in DN correctly.bpo-46195:
typing.get_type_hints()
no longer addsOptional
to parameters withNone
as a default. This aligns to changes to PEP 484 in https://github.com/python/peps/pull/689bpo-31369: Add
RegexFlag
tore.__all__
and documented it. AddNOFLAG
to indicate no flags being set.bpo-45898:
ctypes
no longer definesffi_type_*
symbols incfield.c
. The symbols have been provided by libffi for over a decade.bpo-44953: Calling
operator.itemgetter
objects andoperator.attrgetter
objects is now faster due to use of the vectorcall calling convention.bpo-44289: Fix an issue with
is_tarfile()
method when using fileobj argument: position in the fileobj was advanced forward which made it unreadable withtarfile.TarFile.open()
.bpo-44011: Reimplement SSL/TLS support in asyncio, borrow the implementation from uvloop library.
bpo-41086: Make the
configparser.ConfigParser
constructor raiseTypeError
if theinterpolation
parameter is not of typeconfigparser.Interpolation
bpo-29418: Implement
inspect.ismethodwrapper()
and fixinspect.isroutine()
for cases where methodwrapper is given. Patch by Hakan Çelik.bpo-14156: argparse.FileType now supports an argument of '-' in binary mode, returning the .buffer attribute of sys.stdin/sys.stdout as appropriate. Modes including 'x' and 'a' are treated equivalently to 'w' when argument is '-'. Patch contributed by Josh Rosenberg
Documentation¶
bpo-42238:
Doc/tools/rstlint.py
has moved to its own repository and is now packaged on PyPI assphinx-lint
.
Tests¶
bpo-46913: Fix test_faulthandler.test_sigfpe() if Python is built with undefined behavior sanitizer (UBSAN): disable UBSAN on the faulthandler_sigfpe() function. Patch by Victor Stinner.
bpo-46760: Remove bytecode offsets from expected values in test.test_dis module. Reduces the obstacles to modifying the VM or compiler.
bpo-46708: Prevent default asyncio event loop policy modification warning after
test_asyncio
execution.bpo-46678: The function
make_legacy_pyc
inLib/test/support/import_helper.py
no longer fails whenPYTHONPYCACHEPREFIX
is set to a directory on a different device from where tempfiles are stored.bpo-46623: Skip test_pair() and test_speech128() of test_zlib on s390x since they fail if zlib uses the s390x hardware accelerator. Patch by Victor Stinner.
Build¶
bpo-46860: Respect
--with-suffix
when building on case-insensitive file systems.bpo-46656: Building Python now requires a C11 compiler. Optional C11 features are not required. Patch by Victor Stinner.
bpo-46656: Building Python now requires support for floating point Not-a-Number (NaN): remove the
Py_NO_NAN
macro. Patch by Victor Stinner.bpo-46640: Building Python now requires a C99
<math.h>
header file providing aNAN
constant, or the__builtin_nan()
built-in function. Patch by Victor Stinner.bpo-46608: Exclude marshalled-frozen data if deep-freezing to save 300 KB disk space. This includes adding a new
is_package
field to_frozen
. Patch by Kumar Aditya.bpo-40280: Fix wasm32-emscripten test failures and platform issues. - Disable syscalls that are not supported or don't work, e.g. wait, getrusage, prlimit, mkfifo, mknod, setres[gu]id, setgroups. - Use fd_count to cound open fds. - Add more checks for subprocess and fork. - Add workarounds for missing _multiprocessing and failing socket.accept(). - Enable bzip2. - Disable large file support. - Disable signal.alarm.
bpo-46430: Intern strings in deep-frozen modules. Patch by Kumar Aditya.
Windows¶
bpo-46744: The default all users install directory for ARM64 is now under the native
Program Files
folder, rather thanProgram Files (Arm)
which is intended for ARM (32-bit) files.bpo-46567: Adds Tcl and Tk support for Windows ARM64. This also adds IDLE to the installation.
bpo-46638: Ensures registry virtualization is consistently disabled. For 3.10 and earlier, it remains enabled (some registry writes are protected), while for 3.11 and later it is disabled (registry modifications affect all applications).
IDLE¶
C API¶
bpo-46748: Python's public headers no longer import
<stdbool.h>
, leaving code that embedd/extends Python free to definebool
,true
andfalse
.bpo-46836: Move the
PyFrameObject
type definition (struct _frame
) to the internal C APIpycore_frame.h
header file. Patch by Victor Stinner.bpo-45459: Rename
Include/buffer.h
header file toInclude/pybuffer.h
to avoid conflits with projects having an existingbuffer.h
header file. Patch by Victor Stinner.bpo-45412: Remove the
HAVE_PY_SET_53BIT_PRECISION
macro (moved to the internal C API). Patch by Victor Stinner.bpo-46613: Added function
PyType_GetModuleByDef()
, which allows accesss to module state when a method's defining class is not available.
Python 3.11.0 alpha 5¶
Release date: 2022-02-03
Core and Builtins¶
bpo-45773: Remove two invalid "peephole" optimizations from the bytecode compiler.
bpo-46564: Do not create frame objects when creating
super
object. Patch by Kumar Aditya.bpo-45885: Added more fined-grained specialization failure stats regarding the
COMPARE_OP
bytecode.bpo-44977: The delegation of
int()
to__trunc__()
is now deprecated. Callingint(a)
whentype(a)
implements__trunc__()
but not__int__()
or__index__()
now raises aDeprecationWarning
.bpo-46458: Reorder code emitted by the compiler for a
try
-except
block so that theelse
block's code immediately follows thetry
body (without a jump). This is more optimal for the happy path.bpo-46527: Allow passing
iterable
as a keyword argument toenumerate()
again. Patch by Jelle Zijlstra.bpo-46528: Replace several stack manipulation instructions (
DUP_TOP
,DUP_TOP_TWO
,ROT_TWO
,ROT_THREE
,ROT_FOUR
, andROT_N
) with newCOPY
andSWAP
instructions.bpo-46329: Use two or three bytecodes to implement most calls.
Calls without named arguments are implemented as a sequence of two instructions:
PRECALL; CALL
. Calls with named arguments are implemented as a sequence of three instructions:PRECALL; KW_NAMES; CALL
. There are two differentPRECALL
instructions:PRECALL_FUNTION
andPRECALL_METHOD
. The latter pairs withLOAD_METHOD
.This partition into pre-call and call allows better specialization, and thus better performance ultimately.
There is no change in semantics.
bpo-46503: Fix an assert when parsing some invalid N escape sequences in f-strings.
bpo-46431: Improve error message on invalid calls to
BaseExceptionGroup.__new__()
.bpo-46476: Fix memory leak in code objects generated by deepfreeze. Patch by Kumar Aditya.
bpo-46481: Speed up calls to
weakref.ref.__call__()
by using the PEP 590vectorcall
calling convention. Patch by Donghee Na.bpo-46417: Fix a race condition on setting a type
__bases__
attribute: the internal functionadd_subclass()
now gets thePyTypeObject.tp_subclasses
member after callingPyWeakref_NewRef()
which can trigger a garbage collection which can indirectly modifyPyTypeObject.tp_subclasses
. Patch by Victor Stinner.bpo-46417:
python -X showrefcount
now shows the total reference count after clearing and destroyed the main Python interpreter. Previously, it was shown before. Patch by Victor Stinner.bpo-43683: Add ASYNC_GEN_WRAP opcode to wrap the value to be yielded in async generators. Removes the need to special case async generators in the
YIELD_VALUE
instruction.bpo-46407: Optimize some modulo operations in
Objects/longobject.c
. Patch by Jeremiah Vivian.bpo-46409: Add new
RETURN_GENERATOR
bytecode to make generators. Simplifies calling Python functions in the VM, as they no longer any need to special case generator functions.Also add
JUMP_NO_INTERRUPT
bytecode that acts likeJUMP_ABSOLUTE
, but does not check for interrupts.bpo-46406: The integer division
//
implementation has been optimized to better let the compiler understand its constraints. It can be 20% faster on the amd64 platform when dividing an int by a value smaller than2**30
.bpo-46383: Fix invalid signature of
_zoneinfo
'smodule_free
function to resolve a crash on wasm32-emscripten platform.bpo-46361: Ensure that "small" integers created by
int.from_bytes()
anddecimal.Decimal
are properly cached.bpo-46161: Fix the class building error when the arguments are constants and CALL_FUNCTION_EX is used.
bpo-46028: Fixes calculation of
sys._base_executable
when inside a virtual environment that uses symlinks with different binary names than the base environment provides.bpo-46091: Correctly calculate indentation levels for lines with whitespace character that are ended by line continuation characters. Patch by Pablo Galindo
bpo-30512: Add CAN Socket support for NetBSD.
bpo-46045: Do not use POSIX semaphores on NetBSD
bpo-44024: Improve the
TypeError
message for non-string second arguments passed to the built-in functionsgetattr()
andhasattr()
. Patch by Géry Ogam.
Library¶
bpo-46624: Restore support for non-integer arguments of
random.randrange()
andrandom.randint()
.bpo-46591: Make the IDLE doc URL on the About IDLE dialog clickable.
bpo-46565: Remove loop variables that are leaking into modules' namespaces.
bpo-46553: In
typing.get_type_hints()
, support evaluating bare stringifiedClassVar
annotations. Patch by Gregory Beauregard.bpo-46544: Don't leak
x
&uspace
intermediate vars intextwrap.TextWrapper
.bpo-46487: Add the
get_write_buffer_limits
method toasyncio.transports.WriteTransport
and to the SSL transport.bpo-45173: Note the configparser deprecations will be removed in Python 3.12.
bpo-45162: The deprecated
unittest
APIs removed in 3.11a1 have been temporarily restored to be removed in 3.12 while cleanups in external projects go in.bpo-46539: In
typing.get_type_hints()
, support evaluating stringifiedClassVar
andFinal
annotations insideAnnotated
. Patch by Gregory Beauregard.bpo-46510: Add missing test for
types.TracebackType
andtypes.FrameType
. Calculate them directly from the caught exception without callingsys.exc_info()
.bpo-46491: Allow
typing.Annotated
to wraptyping.Final
andtyping.ClassVar
. Patch by Gregory Beauregard.bpo-46483: Remove
__class_getitem__()
frompathlib.PurePath
as this class was not supposed to be generic.bpo-46436: Fix command-line option
-d
/--directory
in modulehttp.server
which is ignored when combined with command-line option--cgi
. Patch by Géry Ogam.bpo-41403: Make
mock.patch()
raise aTypeError
with a relevant error message on invalid arg. Previously it allowed a crypticAttributeError
to escape.bpo-46474: In
importlib.metadata.EntryPoint.pattern
, avoid potential REDoS by limiting ambiguity in consecutive whitespace.bpo-46474: Removed private method from
importlib.metadata.Path
. Sync with importlib_metadata 4.10.0.bpo-46470: Remove unused branch from
typing._remove_dups_flatten
bpo-46469:
asyncio
generic classes now returntypes.GenericAlias
in__class_getitem__
instead of the same class.bpo-41906: Support passing filter instances in the
filters
values ofhandlers
andloggers
in the dictionary passed tologging.config.dictConfig()
.bpo-46422: Use
dis.Positions
indis.Instruction
instead of a regulartuple
.bpo-46434:
pdb
now gracefully handleshelp
when__doc__
is missing, for example when run with pregenerated optimized.pyc
files.bpo-43869: Python uses the same time Epoch on all platforms. Add an explicit unit test to ensure that it's the case. Patch by Victor Stinner.
bpo-46414: Add
typing.reveal_type()
. Patch by Jelle Zijlstra.bpo-40280:
subprocess
now imports Windows-specific imports whenmsvcrt
module is available, and POSIX-specific imports on all other platforms. This gives a clean exception when_posixsubprocess
is not available (e.g. Emscripten browser target).bpo-40066:
IntEnum
,IntFlag
, andStrEnum
use the mixed-in type for theirstr()
andformat()
output.bpo-46316: Optimize
pathlib.Path.iterdir()
by removing an unnecessary check for special entries.bpo-29688: Document
pathlib.Path.absolute()
(which has always existed).bpo-43012: The pathlib module's obsolete and internal
_Accessor
class has been removed to prepare the terrain for upcoming enhancements to the module.bpo-46258: Speed up
math.isqrt()
for small positive integers by replacing two division steps with a lookup table.bpo-46242: Improve error message when creating a new
enum.Enum
type subclassing an existingEnum
with_member_names_
usingenum.Enum.__call__()
.bpo-43118: Fix a bug in
inspect.signature()
that was causing it to fail on some subclasses of classes with a__text_signature__
referencing module globals. Patch by Weipeng Hong.bpo-26552: Fixed case where failing
asyncio.ensure_future()
did not close the coroutine. Patch by Kumar Aditya.bpo-21987: Fix an issue with
tarfile.TarFile.getmember()
getting a directory name with a trailing slash.bpo-46124: Update
zoneinfo
to rely on importlib.resources traversable API.bpo-46103: Now
inspect.getmembers()
only gets__bases__
attribute from class type. Patch by Weipeng Hong.bpo-46080: Fix exception in argparse help text generation if a
argparse.BooleanOptionalAction
argument's default isargparse.SUPPRESS
and it hashelp
specified. Patch by Felix Fontein.bpo-44791: Fix substitution of
ParamSpec
inConcatenate
with different parameter expressions. Substitution with a list of types returns now a tuple of types. Substitution withConcatenate
returns now aConcatenate
with concatenated lists of arguments.
Documentation¶
bpo-46463: Fixes
escape4chm.py
script used when building the CHM documentation file
Tests¶
bpo-43478: Mocks can no longer be provided as the specs for other Mocks. As a result, an already-mocked object cannot be passed to
mock.Mock()
. This can uncover bugs in tests since these Mock-derived Mocks will always pass certain tests (e.g. isinstance) and builtin assert functions (e.g. assert_called_once_with) will unconditionally pass.bpo-46616: Ensures
test_importlib.test_windows
cleans up registry keys after completion.bpo-44359: test_ftplib now silently ignores socket errors to prevent logging unhandled threading exceptions. Patch by Victor Stinner.
bpo-46600: Fix test_gdb.test_pycfunction() for Python built with
clang -Og
. Tolerate inlined functions in the gdb traceback. Patch by Victor Stinner.bpo-46542: Fix a Python crash in test_lib2to3 when using Python built in debug mode: limit the recursion limit. Patch by Victor Stinner.
bpo-46576: test_peg_generator now disables compiler optimization when testing compilation of its own C extensions to significantly speed up the testing on non-debug builds of CPython.
bpo-46542: Fix
test_json
tests checking forRecursionError
: modify these tests to usesupport.infinite_recursion()
. Patch by Victor Stinner.bpo-13886: Skip test_builtin PTY tests on non-ASCII characters if the readline module is loaded. The readline module changes input() behavior, but test_builtin is not intented to test the readline module. Patch by Victor Stinner.
bpo-40280: Add
test.support.requires_fork()
decorators to mark tests that require a workingos.fork()
.bpo-40280: Add
test.support.requires_subprocess()
decorator to mark tests which require workingsubprocess
module oros.spawn*
. The wasm32-emscripten platform has no support for processes.bpo-46126: Disable 'descriptions' when running tests internally.
Build¶
bpo-46602: Tidied up configure.ac so that conftest.c is truncated rather than appended. This assists in the case where the 'rm' of conftest.c fails to happen between tests. Downstream issues such as a clobbered SOABI can result.
bpo-46600: Fix the test checking if the C compiler supports
-Og
option in the./configure
script to also use-Og
on clang which supports it. Patch by Victor Stinner.bpo-38472: Fix GCC detection in setup.py when cross-compiling. The C compiler is now run with LC_ALL=C. Previously, the detection failed with a German locale.
bpo-46513: configure no longer uses
AC_C_CHAR_UNSIGNED
macro andpyconfig.h
no longer defines reserved symbol__CHAR_UNSIGNED__
.bpo-46471: Use global singletons for single byte bytes objects in deepfreeze.
bpo-46443: Deepfreeze now uses cached small integers as it saves some space for common small integers.
bpo-46429: Merge all deep-frozen files into one for space savings. Patch by Kumar Aditya.
bpo-45569: The build now defaults to using 30-bit digits for Python integers. Previously either 15-bit or 30-bit digits would be selected, depending on the platform. 15-bit digits may still be selected using the
--enable-big-digits=15
option to theconfigure
script, or by definingPYLONG_BITS_IN_DIGIT
inpyconfig.h
.bpo-45925: Update Windows installer to use SQLite 3.37.2.
bpo-43112: Detect musl libc as a separate SOABI (tagged as
linux-musl
).
Windows¶
bpo-33125: The traditional EXE/MSI based installer for Windows is now available for ARM64
bpo-46362: os.path.abspath("C:CON") is now fixed to return "\.CON", not the same path. The regression was true of all legacy DOS devices such as COM1, LPT1, or NUL.
bpo-44934: The installer now offers a command-line only option to add the installation directory to the end of
PATH
instead of at the start.
macOS¶
bpo-45925: Update macOS installer to SQLite 3.37.2.
IDLE¶
bpo-45296: Clarify close, quit, and exit in IDLE. In the File menu, 'Close' and 'Exit' are now 'Close Window' (the current one) and 'Exit' is now 'Exit IDLE' (by closing all windows). In Shell, 'quit()' and 'exit()' mean 'close Shell'. If there are no other windows, this also exits IDLE.
C API¶
bpo-40170: Remove the
PyHeapType_GET_MEMBERS()
macro. It was exposed in the public C API by mistake, it must only be used by Python internally. Use thePyTypeObject.tp_members
member instead. Patch by Victor Stinner.bpo-40170: Move _Py_GetAllocatedBlocks() and _PyObject_DebugMallocStats() private functions to the internal C API. Patch by Victor Stinner.
bpo-46433: The internal function _PyType_GetModuleByDef now correctly handles inheritance patterns involving static types.
bpo-45459:
Py_buffer
and variousPy_buffer
related functions are now part of the limited API and stable ABI.bpo-14916: Fixed bug in the tokenizer that prevented
PyRun_InteractiveOne
from parsing from the provided FD.
Python 3.11.0 alpha 4¶
Release date: 2022-01-13
Core and Builtins¶
bpo-46070:
Py_EndInterpreter()
now explicitly untracks all objects currently tracked by the GC. Previously, if an object was used later by another interpreter, callingPyObject_GC_UnTrack()
on the object crashed if the previous or the next object of thePyGC_Head
structure became a dangling pointer. Patch by Victor Stinner.bpo-46347: Fix memory leak in PyEval_EvalCodeEx.
bpo-46339: Fix a crash in the parser when retrieving the error text for multi-line f-strings expressions that do not start in the first line of the string. Patch by Pablo Galindo
bpo-46331: Do not set line number of instruction storing doc-string. Fixes regression introduced in 3.11 alpha.
bpo-46314: Remove spurious "call" event when creating a lambda function that was accidentally introduced in 3.11a4.
bpo-46289: ASDL declaration of
FormattedValue
has changed to reflectconversion
field is not optional.bpo-46297: Fixed an interpreter crash on bootup with multiple PythonPaths set in the Windows registry. Patch by Derzsi Dániel.
bpo-46237: Fix the line number of tokenizer errors inside f-strings. Patch by Pablo Galindo.
bpo-46263: We always expect the "use_frozen_modules" config to be set, now that getpath.c was rewritten in pure Python and the logic improved.
bpo-46006: Fix a regression when a type method like
__init__()
is modified in a subinterpreter. Fix a regression in_PyUnicode_EqualToASCIIId()
and typeupdate_slot()
. Revert the change which made the Unicode dictionary of interned strings compatible with subinterpreters: the internal interned dictionary is shared again by all interpreters. Patch by Victor Stinner.bpo-45923: Add RESUME opcode. This is a logical no-op. It is emitted by the compiler anywhere a Python function can be entered. It is used by the interpreter to perform tracing and optimizer checks.
bpo-46208: Fix the regression of os.path.normpath("A/../../B") not returning expected "../B" but "B".
bpo-46240: Correct the error message for unclosed parentheses when the tokenizer doesn't reach the end of the source when the error is reported. Patch by Pablo Galindo
bpo-46009: Remove the
GEN_START
opcode.bpo-46235: Certain sequence multiplication operations like
[0] * 1_000
are now faster due to reference-counting optimizations. Patch by Dennis Sweeney.bpo-46221:
PREP_RERAISE_STAR
no longer pusheslasti
to the stack.bpo-46202: Remove
POP_EXCEPT_AND_RERAISE
and replace it by an equivalent sequence of other opcodes.bpo-46085: Fix iterator cache mechanism of
OrderedDict
.bpo-46055: Speed up shifting operation involving integers less than
PyLong_BASE
. Patch by Xinhang Xu.bpo-46110: Add a maximum recursion check to the PEG parser to avoid stack overflow. Patch by Pablo Galindo
bpo-46107: Fix bug where
ExceptionGroup.split()
andExceptionGroup.subgroup()
did not copy the exception group's__note__
field to the parts.bpo-45711: The interpreter state's representation of handled exceptions (a.k.a exc_info, or _PyErr_StackItem) now has only the
exc_value
field,exc_type
andexc_traceback
have been removed as their values can be derived fromexc_value
.bpo-44525: Replace the four call bytecode instructions which one pre-call instruction and two call instructions.
Removes
CALL_FUNCTION
,CALL_FUNCTION_KW
,CALL_METHOD
andCALL_METHOD_KW
.Adds
CALL_NO_KW
andCALL_KW
call instructions, andPRECALL_METHOD
prefix for pairing withLOAD_METHOD
.bpo-46039: Remove the
YIELD_FROM
instruction and replace it with theSEND
instruction which performs the same operation, but without the loop.bpo-45635: The code called from
_PyErr_Display()
was refactored to improve error handling. It now exits immediately upon an unrecoverable error.bpo-46054: Fix parser error when parsing non-utf8 characters in source files. Patch by Pablo Galindo.
bpo-46042: Improve the location of the caret in
SyntaxError
exceptions emitted by the symbol table. Patch by Pablo Galindo.bpo-46049: Ensure
._pth
files work as intended on platforms other than Windows.bpo-46048: Fixes parsing of
._pth
files on startup so that single-character paths are correctly read.bpo-37971: Fix a bug where the line numbers given in a traceback when a decorator application raised an exception were wrong.
bpo-46031: Add
POP_JUMP_IF_NOT_NONE
andPOP_JUMP_IF_NONE
opcodes to speed up conditional jumps.bpo-46025: Fix a crash in the
atexit
module involving functions that unregister themselves before raising exceptions. Patch by Pablo Galindo.bpo-46000: Improve compatibility of the
curses
module with NetBSD curses.bpo-44525: Specialize the CALL_FUNCTION instruction for calls to builtin types with a single argument. Speeds up
range(x)
,list(x)
, and specificallytype(obj)
.bpo-42918: Fix bug where the built-in
compile()
function did not always raise aSyntaxError
when passed multiple statements in 'single' mode. Patch by Weipeng Hong.bpo-45953: The main interpreter in _PyRuntimeState.interpreters is now statically allocated (as part of _PyRuntime). Likewise for the initial thread state of each interpreter. This means less allocation during runtime init, as well as better memory locality for these key state objects.
bpo-45292: Complete the PEP 654 implementation: add
except*
.bpo-43413: Revert changes in
set.__init__
. Subclass ofset
needs to define a__init__()
method if it defines a__new__()
method with additional keyword parameters.bpo-43931: Added the
Py_Version
constant which bears the same value asPY_VERSION_HEX
. Patch by Gabriele N. Tornetta.
Library¶
bpo-46342: The
@typing.final
decorator now sets the__final__
attribute on the decorated object to allow runtime introspection. Patch by Jelle Zijlstra.bpo-46328: Added the
sys.exception()
method which returns the active exception instance.bpo-46307: Add
string.Template.is_valid()
andstring.Template.get_identifiers()
methods.bpo-46306: Assume that
types.CodeType
always hastypes.CodeType.co_firstlineno
indoctest
.bpo-40479: Fix
hashlib
usedforsecurity option to work correctly with OpenSSL 3.0.0 in FIPS mode.bpo-46070: Fix possible segfault when importing the
asyncio
module from different sub-interpreters in parallel. Patch by Erlend E. Aasland.bpo-46244: Removed
__slots__
fromtyping.ParamSpec
andtyping.TypeVar
. They served no purpose. Patch by Arie Bovenberg.bpo-46278: Reflect
context
argument inAbstractEventLoop.call_*()
methods. Loop implementations already support it.bpo-46269: Remove special-casing of
__new__
inenum.Enum.__dir__()
.bpo-46266: Improve day constants in
calendar
.Now all constants (
MONDAY
...SUNDAY
) are documented, tested, and added to__all__
.bpo-46257: Optimized the mean, variance, and stdev functions in the statistics module. If the input is an iterator, it is consumed in a single pass rather than eating memory by conversion to a list. The single pass algorithm is about twice as fast as the previous two pass code.
bpo-41011: Added two new variables to pyvenv.cfg which is generated by
venv
module: executable for the executable and command for the command line used to create the environment.bpo-46239: Improve error message when importing
asyncio.windows_events
on non-Windows.bpo-46238: Reuse
_winapi
constants inasyncio.windows_events
.bpo-46222: Adding
SF_NOCACHE
sendfile constant for FreeBSD for the posixmodule.bpo-37295: Add fast path for
0 <= k <= n <= 67
formath.comb()
.bpo-46176: Adding the
MAP_STACK
constant for the mmap module.bpo-43424: Deprecate
webbrowser.MacOSXOSAScript._name
and usename
instead.bpo-45321: Added missing error codes to module
xml.parsers.expat.errors
.bpo-46125: Refactor tests to test traversable API directly. Includes changes from importlib 5.4.0.
bpo-46118: Moved importlib.resources and its related functionality to a package.
bpo-37578: Add include_hidden parameter to
glob()
andiglob()
to match hidden files and directories when using special characters like*
,**
,?
and[]
.bpo-20369:
concurrent.futures.wait()
no longer blocks forever when given duplicate Futures. Patch by Kumar Aditya.bpo-46105: Honor spec when generating requirement specs with urls and extras (importlib_metadata 4.8.3).
bpo-44893: EntryPoint objects are no longer tuples. Recommended means to access is by attribute ('.name', '.group') or accessor ('.load()'). Access by index is deprecated and will raise deprecation warning.
bpo-22815: Print unexpected successes together with failures and errors in summary in
unittest.TextTestResult
.bpo-22047: Calling
add_argument_group()
on an argument group is deprecated. Callingadd_argument_group()
oradd_mutually_exclusive_group()
on a mutually exclusive group is deprecated.These features were never supported and do not always work correctly. The functions exist on the API by accident through inheritance and will be removed in the future.
bpo-26952:
argparse
raisesValueError
with clear message when trying to render usage for an empty mutually exclusive group. Previously it raised a crypticIndexError
.bpo-45615: Functions in the
traceback
module raiseTypeError
rather thanAttributeError
when an exception argument is not of typeBaseException
.bpo-16594: Add allow allow_reuse_port flag in socketserver.
bpo-27718: Fix help for the
signal
module. Some functions (e.g.signal()
andgetsignal()
) were omitted.bpo-46032: The
registry()
method offunctools.singledispatch()
functions checks now the first argument or the first parameter annotation and raises a TypeError if it is not supported. Previously unsupported "types" were ignored (e.g.typing.List[int]
) or caused an error at calling time (e.g.list[int]
).bpo-46014: Add ability to use
typing.Union
andtypes.UnionType
as dispatch argument tofunctools.singledispatch
. Patch provided by Yurii Karabas.bpo-46018: Ensure that
math.expm1()
does not raise on underflow.bpo-46016: Adding
F_DUP2FD
andF_DUP2FD_CLOEXEC
constants from FreeBSD into the fcntl module.bpo-45755:
typing
generic aliases now reveal the class attributes of the original generic class when passed todir()
. This was the behavior up to Python 3.6, but was changed in 3.7-3.9.bpo-45874: The empty query string, consisting of no query arguments, is now handled correctly in
urllib.parse.parse_qsl
. This caused problems before when strict parsing was enabled.bpo-44674: Change how dataclasses disallows mutable default values. It used to use a list of known types (list, dict, set). Now it disallows unhashable objects to be defaults. It's using unhashability as a proxy for mutability. Patch by Eric V. Smith, idea by Raymond Hettinger.
bpo-23882: Remove namespace package (PEP 420) support from unittest discovery. It was introduced in Python 3.4 but has been broken since Python 3.7.
bpo-25066: Added a
__repr__()
method tomultiprocessing.Event
objects, patch by Kumar Aditya.bpo-45643: Added
signal.SIGSTKFLT
on platforms where this signal is defined.bpo-44092: Fetch across rollback no longer raises
InterfaceError
. Instead we leave it to the SQLite library to handle these cases. Patch by Erlend E. Aasland.bpo-42413: Replace
concurrent.futures.TimeoutError
andasyncio.TimeoutError
with builtinTimeoutError
, keep these names as deprecated aliases.
Documentation¶
Tests¶
bpo-46296: Add a test case for
enum
with_use_args_ == True
and_member_type_ == object
.bpo-46205: Fix hang in runtest_mp due to race condition
bpo-46263: Fix test_capi on FreeBSD 14-dev: instruct jemalloc to not fill freed memory with junk byte.
bpo-46262: Cover
ValueError
path in tests forenum.Flag._missing_()
.bpo-46150: Now
fakename
intest_pathlib.PosixPathTest.test_expanduser
is checked to be non-existent.bpo-46129: Rewrite
asyncio.locks
tests withunittest.IsolatedAsyncioTestCase
usage.bpo-23819: Fixed
asyncio
tests in python optimized mode. Patch by Kumar Aditya.bpo-46114: Fix test case for OpenSSL 3.0.1 version. OpenSSL 3.0 uses
0xMNN00PP0L
.
Build¶
bpo-44133: When Python is configured with
--without-static-libpython
, the Python static library (libpython.a) is no longer built. Patch by Victor Stinner.bpo-44133: When Python is built without
--enable-shared
, thepython
program is now linked to object files, rather than being linked to the Python static library (libpython.a), to make sure that all symbols are exported. Previously, the linker omitted some symbols like thePy_FrozenMain()
function. Patch by Victor Stinner.bpo-40280: The
configure
script has a new option--with-emscripten-target
to select browser or node as Emscripten build target.bpo-46315: Added and fixed
#ifdef HAVE_FEATURE
checks for functionality that is not available on WASI platform.bpo-45723: Fixed a regression in
configure
check forselect.epoll()
.bpo-46263:
configure
no longer setsMULTIARCH
on FreeBSD platforms.bpo-46106: Updated OpenSSL to 1.1.1m in Windows builds, macOS installer builds, and CI. Patch by Kumar Aditya.
bpo-46088: Automatically detect or install bootstrap Python runtime when building from Visual Studio.
bpo-46072: Add a --with-pystats configure option to turn on internal statistics gathering.
bpo-40280: A new directory
Tools/wasm
contains WebAssembly-related helpers likeconfig.site
override for wasm32-emscripten, wasm assets generator to bundle the stdlib, and a README.bpo-46023: makesetup no longer builds extensions that have been marked as disabled. This allows users to disable modules in
Modules/Setup.local
.bpo-45949: Use pure Python
freeze_module
for all but importlib bootstrap files.--with-freeze-module
configure option is no longer needed for cross builds.
Windows¶
bpo-46217: Removed parameter that is unsupported on Windows 8.1 and early Windows 10 and may have caused build or runtime failures.
macOS¶
bpo-40477: The Python Launcher app for macOS now properly launches scripts and, if necessary, the Terminal app when running on recent macOS releases.
C API¶
bpo-46236: Fix a bug in
PyFunction_GetAnnotations()
that caused it to return atuple
instead of adict
.bpo-46140:
PyBuffer_GetPointer()
,PyBuffer_FromContiguous()
,PyBuffer_ToContiguous()
andPyMemoryView_FromBuffer()
now take buffer info byconst Py_buffer *
instead ofPy_buffer *
, as they do not need mutability.PyBuffer_FromContiguous()
also now takes the source buffer asconst void *
, and similarlyPyBuffer_GetPointer()
takes the strides asconst Py_ssize_t *
.bpo-45855: Document that the no_block argument to
PyCapsule_Import()
is a no-op now.bpo-45855: Replaced deprecated usage of
PyImport_ImportModuleNoBlock()
withPyImport_ImportModule()
in stdlib modules. Patch by Kumar Aditya.bpo-46007: The
PyUnicode_CHECK_INTERNED()
macro has been excluded from the limited C API. It was never usable there, because it used internal structures which are not available in the limited C API. Patch by Victor Stinner.
Python 3.11.0 alpha 3¶
Release date: 2021-12-08
Core and Builtins¶
bpo-46009: Restore behavior from 3.9 and earlier when sending non-None to newly started generator. In 3.9 this did not affect the state of the generator. In 3.10.0 and 3.10.1
gen_func().send(0)
is equivalent togen_func().throw(TypeError(...)
which exhausts the generator. In 3.10.2 onward, the behavior has been reverted to that of 3.9.bpo-46004: Fix the
SyntaxError
location for errors involving for loops with invalid targets. Patch by Pablo Galindobpo-45711:
_PyErr_ChainStackItem()
no longer normalizesexc_info
(including setting the traceback on the exception instance) becauseexc_info
is always normalized.bpo-45607: The
__note__
field was added toBaseException
. It isNone
by default but can be set to a string which is added to the exception's traceback.bpo-45947: Place pointers to dict and values immediately before GC header. This reduces number of dependent memory loads to access either dict or values from 3 to 1.
bpo-45915:
is_valid_fd
now uses fasterfcntl(fd, F_GETFD)
on Linux, macOS, and Windows.bpo-44530: Reverts a change to the
code.__new__
audit event from an earlier prerelease.bpo-42268: Fail the configure step if the selected compiler doesn't support memory sanitizer. Patch by Pablo Galindo
bpo-45711: The three values of
exc_info
are now always consistent with each other. In particular, thetype
andtraceback
fields are now derived from the exception instance. This impacts the return values ofsys.exc_info()
andPyErr_GetExcInfo()
if the exception instance is modified while the exception is handled, as well asPyErr_SetExcInfo()
, which now ignores thetype
andtraceback
arguments provided to it.bpo-45727: Refine the custom syntax error that suggests that a comma may be missing to trigger only when the expressions are detected between parentheses or brackets. Patch by Pablo Galindo
bpo-45885: Specialized the
COMPARE_OP
opcode using the PEP 659 machinery.bpo-45786: Allocate space for the interpreter frame in the frame object, to avoid an additional allocation when the frame object outlives the frame activation.
bpo-45614: Fix
traceback
display for exceptions with invalid module name.bpo-45813: Fix crash when calling coro.cr_frame.clear() after coroutine has been freed.
bpo-45811: Improve the tokenizer errors when encountering invisible control characters in the parser. Patch by Pablo Galindo
bpo-45848: Allow the parser to obtain error lines directly from encoded files. Patch by Pablo Galindo
bpo-45709: Restore behavior from 3.10 when tracing an exception raised within a with statement.
bpo-44525: Adds new
COPY_FREE_VARS
opcode, to make copying of free variables from function to frame explicit. Helps optimization of calls to Python function.bpo-45829: Specialize
BINARY_SUBSCR
for classes with a__getitem__
method implemented in Pythonbpo-45826: Fixed a crash when calling
.with_traceback(None)
onNameError
. This occurs internally inunittest.TestCase.assertRaises()
.bpo-45822: Fixed a bug in the parser that was causing it to not respect PEP 263 coding cookies when no flags are provided. Patch by Pablo Galindo
bpo-45820: Fix a segfault when the parser fails without reading any input. Patch by Pablo Galindo
bpo-45636: Simplify the implementation of
BINARY_OP
by indexing into an array of function pointers (rather than switching on the oparg).bpo-42540: Fix crash when
os.fork()
is called with an active non-default memory allocator.bpo-45738: Fix computation of error location for invalid continuation characters in the parser. Patch by Pablo Galindo.
bpo-45636: Remove an existing "fast path" for old-style string formatting, since it no longer appears to have any measurable impact.
bpo-45753: Make recursion checks a bit more efficient by tracking amount of calls left before overflow.
bpo-45773: Fix a compiler hang when attempting to optimize certain jump patterns.
bpo-45764: The parser now gives a better error message when leaving out the opening parenthesis
(
after adef
-statement:>>> def f: File "<stdin>", line 1 def f: ^ SyntaxError: expected '('
bpo-45609: Specialized the
STORE_SUBSCR
opcode using the PEP 659 machinery.bpo-45636: Replace all numeric
BINARY_*
andINPLACE_*
instructions with a singleBINARY_OP
implementation.bpo-45582: Path calculation (known as
getpath
) has been reimplemented as a frozen Python module. This should have no visible impact, but may affect calculation of all paths referenced insys
andsysconfig
.bpo-45450: Improve the syntax error message for parenthesized arguments. Patch by Pablo Galindo.
Library¶
bpo-27946: Fix possible crash when getting an attribute of
xml.etree.ElementTree.Element
simultaneously with replacing theattrib
dict.bpo-45711: Make
asyncio
normalize exceptions as soon as they are captured withPyErr_Fetch()
, and before they are stored as an exc_info triplet. This bringsasyncio
in line with the rest of the codebase, where an exc_info triplet is always normalized.bpo-23819: Replaced asserts with exceptions in asyncio, patch by Kumar Aditya.
bpo-13236:
unittest.TextTestResult
andunittest.TextTestRunner
flush now the output stream more often.bpo-45917: Added
math.exp2()
:, which returns 2 raised to the power of x.bpo-37658: Fix issue when on certain conditions
asyncio.wait_for()
may allow a coroutine to complete successfully, but fail to return the result, potentially causing memory leaks or other issues.bpo-45876: Improve the accuracy of stdev() and pstdev() in the statistics module. When the inputs are floats or fractions, the output is a correctly rounded float
bpo-44649: Handle dataclass(slots=True) with a field that has default a default value, but for which init=False.
bpo-45803: Added missing kw_only parameter to dataclasses.make_dataclass().
bpo-45837: The
turtle.RawTurtle.settiltangle()
is deprecated since Python 3.1, it now emits a deprecation warning and will be removed in Python 3.13.Use
turtle.RawTurtle.tiltangle()
instead.turtle.RawTurtle.tiltangle()
was earlier incorrectly marked as deprecated, its docstring has been corrected.Patch by Hugo van Kemenade.
bpo-45831:
faulthandler
can now write ASCII-only strings (like filenames and function names) with a single write() syscall when dumping a traceback. It reduces the risk of getting an unreadable dump when two threads or two processes dump a traceback to the same file (like stderr) at the same time. Patch by Victor Stinner.bpo-45828:
sqlite
C callbacks now use unraisable exceptions if callback tracebacks are enabled. Patch by Erlend E. Aasland.bpo-41735: Fix thread lock in
zlib.Decompress.flush()
method beforePyObject_GetBuffer
.bpo-45235: Reverted an argparse bugfix that caused regression in the handling of default arguments for subparsers. This prevented leaf level arguments from taking precedence over root level arguments.
bpo-45754: Fix a regression in Python 3.11a1 and 3.11a2 where
sqlite3
incorrectly would useSQLITE_LIMIT_LENGTH
when checking SQL statement lengths. Now,SQLITE_LIMIT_SQL_LENGTH
is used. Patch by Erlend E. Aasland.bpo-45766: Added proportional option to
statistics.linear_regression()
.bpo-45765: In importlib.metadata, fix distribution discovery for an empty path.
bpo-45757: Fix bug where
dis
produced an incorrect oparg whenEXTENDED_ARG
is followed by an opcode that does not use its argument.bpo-45644: In-place JSON file formatting using
python3 -m json.tool infile infile
now works correctly, previously it left the file empty. Patch by Chris Wesseling.bpo-45703: When a namespace package is imported before another module from the same namespace is created/installed in a different
sys.path
location while the program is running, calling theimportlib.invalidate_caches()
function will now also guarantee the new module is noticed.bpo-45535: Improve output of
dir()
with Enums.bpo-45664: Fix
types.resolve_bases()
andtypes.new_class()
fortypes.GenericAlias
instance as a base.bpo-45663: Fix
dataclasses.is_dataclass()
for dataclasses which are subclasses oftypes.GenericAlias
.bpo-45662: Fix the repr of
dataclasses.InitVar
with a type alias to the built-in class, e.g.InitVar[list[int]]
.bpo-43137: Launch GNOME web browsers via gio tool instead of obsolete gvfs-open
bpo-45429: On Windows,
time.sleep()
now uses a waitable timer which supports high-resolution timers. Patch by Donghee Na and Eryk Sun.bpo-37295: Optimize
math.comb()
andmath.perm()
.bpo-45514: Deprecated legacy functions in
importlib.resources
.bpo-45507: Add tests for truncated/missing trailers in gzip.decompress implementation.
bpo-45359: Implement PEP 585 for
graphlib.TopologicalSorter
.bpo-44733: Add
max_tasks_per_child
toconcurrent.futures.ProcessPoolExecutor
. This allows users to specify the maximum number of tasks a single process should execute before the process needs to be restarted.bpo-28806: Improve netrc library. netrc file no longer needs to contain all tokens. And if the login name is anonymous, security check is no longer need.
bpo-43498: Avoid a possible "RuntimeError: dictionary changed size during iteration" when adjusting the process count of
ProcessPoolExecutor
.bpo-42158: Add MIME types for N-quads, N-triples, Notation3 and TriG to
mimetypes
.bpo-30533: Add
inspect.getmembers_static()
, it return all members without triggering dynamic lookup via the descriptor protocol. Patch by Weipeng Hong.
Documentation¶
bpo-42238:
make -C Doc suspicious
will be removed soon in favor ofmake -C Doc check
, mark it as deprecated.bpo-45840: Improve cross-references in the documentation for the data model.
bpo-45640: Properly marked-up grammar tokens in the documentation are now clickable and take you to the definition of a given piece of grammar. Patch by Arthur Milchior.
bpo-45788: Link doc for sys.prefix to sysconfig doc on installation paths.
bpo-45772:
socket.socket
documentation is corrected to a class from a function.bpo-45392: Update the docstring of the
type
built-in to remove a redundant line and to mention keyword arguments for the constructor.bpo-45250: Update the documentation to note that CPython does not consistently require iterators to define
__iter__
.bpo-25381: In the extending chapter of the extending doc, update a paragraph about the global variables containing exception information.
bpo-43905: Expanded
astuple()
andasdict()
docs, warning about deepcopy being applied and providing a workaround.
Tests¶
bpo-45695: Out-of-tree builds with a read-only source directory are now tested by CI.
bpo-19460: Add new Test for
Lib/email/mime/nonmultipart.py::MIMENonMultipart
.bpo-45835: Fix race condition in test_queue tests with multiple "feeder" threads.
bpo-45783: The test for the freeze tool now handles file moves and deletions.
bpo-45745: Remove the
--findleaks
command line option of regrtest: use the--fail-env-changed
option instead. Since Python 3.7, it was a deprecated alias to the--fail-env-changed
option.bpo-45701: Add tests with
tuple
type withfunctools.lru_cache()
totest_functools
.
Build¶
bpo-44035: CI now verifies that autoconf files have been regenerated with a current and unpatched autoconf package.
bpo-45950: The build system now uses a _bootstrap_python interpreter for freezing and deepfreezing again. To speed up build process the build tools _bootstrap_python and _freeze_module are no longer build with LTO.
bpo-45881: The configure script now accepts
--with-build-python
and--with-freeze-module
options to make cross compiling easier.bpo-40280: Emscripten platform now uses
.wasm
suffix by default.bpo-40280: Disable unusable core extension modules on WASM/Emscripten targets.
bpo-40280:
configure
now checks for socketshutdown
function. The check makes it possible to disableSYS_shutdown
withac_cv_func_shutdown=no
in CONFIG_SITE.bpo-40280:
configure
now checks for functionsfork1, getegid, geteuid, getgid, getppid, getuid, opendir, pipe, system, wait, ttyname
.bpo-33393: Update
config.guess
to 2021-06-03 andconfig.sub
to 2021-08-14.Makefile
now has anupdate-config
target to make updating more convenient.bpo-45866:
make regen-all
now produces the same output when run from a directory other than the source tree: when building Python out of the source tree. pegen now strips directory of the "generated by pygen from <FILENAME>" header Patch by Victor Stinner.bpo-40280:
configure
now accepts machinewasm32
orwasm64
and OSwasi
oremscripten
for cross building, e.g.wasm32-unknown-emscripten
,wasm32-wasi
, orwasm32-unknown-wasi
.bpo-41498: Python now compiles on platforms without
sigset_t
. Several functions insignal
are not available whensigset_t
is missing.Based on patch by Roman Yurchak for pyodide.
bpo-45881:
setup.py
now usesCC
from environment first to discover multiarch and cross compile paths.bpo-45886: The
_freeze_module
program path can now be overridden on the command line, e.g.make FREEZE_MODULE=../x86_64/Program/_freeze_module
.bpo-45873: Get rid of the
_bootstrap_python
build step. The deepfreeze.py script is now run using$(PYTHON_FOR_REGEN)
which can be Python 3.7 or newer (on Windows, 3.8 or newer).bpo-45847: Port builtin hashlib extensions to
PY_STDLIB_MOD
macro andaddext()
.bpo-45723: Add
autoconf
helpers for saving and restoring environment variables:SAVE_ENV
: Save$CFLAGS
,$LDFLAGS
,$LIBS
, and$CPPFLAGS
.RESTORE_ENV
: Restore$CFLAGS
,$LDFLAGS
,$LIBS
, and$CPPFLAGS
.WITH_SAVE_ENV([SCRIPT])
: RunSCRIPT
wrapped withSAVE_ENV
andRESTORE_ENV
.
Patch by Erlend E. Aasland.
bpo-45573: Mandatory core modules, that are required to bootstrap Python, are now in
Modules/Setup.bootstrap
.bpo-45573:
configure
now createsModules/Setup.stdlib
with conditionally enabled/disabled extension module lines. The file is not used, yet.bpo-45573:
configure
now uses a unified format to set state, compiler flags, and linker flags in Makefile. The new macroPY_STDLIB_MOD
sets three variables that are consumed byModules/Setup
andsetup.py
.bpo-45816: Python now supports building with Visual Studio 2022 (MSVC v143, VS Version 17.0). Patch by Jeremiah Vivian.
bpo-45800: Settings for
pyexpat
C extension are now detected byconfigure
. The bundledexpat
library is built inMakefile
.bpo-45798: Settings for
decimal
internal C extension are now detected byconfigure
. The bundledlibmpdec
library is built inMakefile
.bpo-45723: configure has a new option
--with-pkg-config
to disable or require pkg-config.bpo-45774: The build dependencies for
sqlite3
are now detected byconfigure
andpkg-config
. Patch by Erlend E. Aasland.bpo-45763: The build dependencies for
zlib
,bz2
, andlzma
are now detected byconfigure
.bpo-45747: gdbm and dbm build dependencies are now detected by
configure
.bpo-45743: On macOS, the build system no longer passes
search_paths_first
to the linker. The flag has been the default since Xcode 4 / macOS 10.6.bpo-45723:
configure.ac
is now compatible with autoconf 2.71. Deprecated checksSTDC_HEADERS
andAC_HEADER_TIME
have been removed.bpo-45723:
configure
now prints a warning when pkg-config is missing.bpo-45731:
configure --enable-loadable-sqlite-extensions
is now handled by newPY_SQLITE_ENABLE_LOAD_EXTENSION
macro instead of logic in setup.py.bpo-45723: configure.ac now uses custom helper macros and
AC_CACHE_CHECK
to simplify and speed up configure runs.bpo-45696: Skip the marshal step for frozen modules by generating C code that produces a set of ready-to-use code objects. This speeds up startup time by another 10% or more.
bpo-45561: Run smelly.py tool from $(srcdir).
Windows¶
bpo-46105: Fixed calculation of
sys.path
in a venv on Windows.bpo-45901: When installed through the Microsoft Store and set as the default app for
*.py
files, command line arguments will now be passed to Python when invoking a script without explicitly launching Python (that is,script.py args
rather thanpython script.py args
).bpo-45616: Fix Python Launcher's ability to distinguish between versions 3.1 and 3.10 when either one is explicitly requested. Previously, 3.1 would be used if 3.10 was requested but not installed, and 3.10 would be used if 3.1 was requested but 3.10 was installed.
bpo-45850: Implement changes to build with deep-frozen modules on Windows. Note that we now require Python 3.10 as the "bootstrap" or "host" Python.
bpo-45732: Updates bundled Tcl/Tk to 8.6.12.
bpo-45720: Internal reference to
shlwapi.dll
was dropped to help improve startup time. This DLL will no longer be loaded at the start of every Python process.
macOS¶
bpo-45732: Update python.org macOS installer to use Tcl/Tk 8.6.12.
C API¶
bpo-39026: Fix Python.h to build C extensions with Xcode: remove a relative include from
Include/cpython/pystate.h
.
Python 3.11.0 alpha 2¶
Release date: 2021-11-05
Core and Builtins¶
bpo-45716: Improve the
SyntaxError
message when usingTrue
,None
orFalse
as keywords in a function call. Patch by Pablo Galindo.bpo-45688:
sys.stdlib_module_names
now contains the macOS-specific module_scproxy
.bpo-45379: Clarify
ImportError
message when we try to explicitly import a frozen module but frozen modules are disabled.bpo-44525: Specialize simple calls to Python functions (no starargs, keyowrd dict, or closure)
bpo-45530: Cases of sorting using tuples as keys may now be significantly faster in some cases. Patch by Tim Peters.
The order of the result may differ from earlier releases if the tuple elements don't define a total ordering (see Comparaisons de valeurs for information on total ordering). It's generally true that the result of sorting simply isn't well-defined in the absence of a total ordering on list elements.
bpo-45526: In obmalloc, set ADDRESS_BITS to not ignore any bits (ignored 16 before). That is safer in the case that the kernel gives user-space virtual addresses that span a range greater than 48 bits.
bpo-30570: Fixed a crash in
issubclass()
from infinite recursion when searching pathological__bases__
tuples.bpo-45521: Fix a bug in the obmalloc radix tree code. On 64-bit machines, the bug causes the tree to hold 46-bits of virtual addresses, rather than the intended 48-bits.
bpo-45494: Fix parser crash when reporting errors involving invalid continuation characters. Patch by Pablo Galindo.
bpo-45445: Python now fails to initialize if it finds an invalid
-X
option in the command line. Patch by Pablo Galindo.bpo-45340: Object attributes are held in an array instead of a dictionary. An object's dictionary are created lazily, only when needed. Reduces the memory consumption of a typical Python object by about 30%. Patch by Mark Shannon.
bpo-45408: Fix a crash in the parser when reporting tokenizer errors that occur at the same time unclosed parentheses are detected. Patch by Pablo Galindo.
bpo-29410: Add SipHash13 for string hash algorithm and use it by default.
bpo-45385: Fix reference leak from descr_check. Patch by Donghee Na.
bpo-45367: Specialized the
BINARY_MULTIPLY
opcode toBINARY_MULTIPLY_INT
andBINARY_MULTIPLY_FLOAT
using the PEP 659 machinery.bpo-21736: Frozen stdlib modules now have
__file__
to the .py file they would otherwise be loaded from, if possible. For packages,__path__
now has the correct entry instead of being an empty list, which allows unfrozen submodules to be imported. These are set only if the stdlib directory is known when the runtime is initialized. Note that the file at__file__
is not guaranteed to exist. None of this affects non-stdlib frozen modules nor, for now, frozen modules imported usingPyImport_ImportFrozenModule()
. Also, at the momentco_filename
is not updated for the module.bpo-45020: For frozen stdlib modules, record the original module name as
module.__spec__.loader_state.origname
. If the value is different thanmodule.__spec__.name
then the module was defined as an alias in Tools/scripts/freeze_modules.py. If it isNone
then the module comes from a source file outside the stdlib.bpo-45324: In FrozenImporter.find_spec(), we now preserve the information needed in exec_module() to load the module. This change mostly impacts internal details, rather than changing the importer's behavior.
bpo-45292: Implement PEP 654. Add
ExceptionGroup
andBaseExceptionGroup
. Update traceback display code.bpo-40116: Change to the implementation of split dictionaries. Classes where the instances differ either in the exact set of attributes, or in the order in which those attributes are set, can still share keys. This should have no observable effect on users of Python or the C-API. Patch by Mark Shannon.
bpo-44050: Extensions that indicate they use global state (by setting
m_size
to -1) can again be used in multiple interpreters. This reverts to behavior of Python 3.8.bpo-44525: Setup initial specialization infrastructure for the
CALL_FUNCTION
opcode. Implemented initial specializations for C function calls:CALL_FUNCTION_BUILTIN_O
forMETH_O
flag.CALL_FUNCTION_BUILTIN_FAST
forMETH_FASTCALL
flag without keywords.CALL_FUNCTION_LEN
forlen(o)
.CALL_FUNCTION_ISINSTANCE
forisinstance(o, t)
.
bpo-44511: Improve the generated bytecode for class and mapping patterns.
bpo-43706: Speed up calls to
enumerate()
by using the PEP 590vectorcall
calling convention. Patch by Donghee Na.
Library¶
bpo-45679: Fix caching of multi-value
typing.Literal
.Literal[True, 2]
is no longer equal toLiteral[1, 2]
.bpo-42064: Convert
sqlite3
to multi-phase initialisation (PEP 489). Patches by Erlend E. Aasland.bpo-45438: Fix typing.Signature string representation for generic builtin types.
bpo-45613:
sqlite3
now setssqlite3.threadsafety
based on the default threading mode the underlying SQLite library has been compiled with. Patch by Erlend E. Aasland.bpo-45574: Fix warning about
print_escape
being unused.bpo-45581:
sqlite3.connect()
now correctly raisesMemoryError
if the underlying SQLite API signals memory error. Patch by Erlend E. Aasland.bpo-45557: pprint.pprint() now handles underscore_numbers correctly. Previously it was always setting it to False.
bpo-44019: Add
operator.call()
tooperator.__all__
. Patch by Kreusada.bpo-42174:
shutil.get_terminal_size()
now falls back to sane values if the column or line count are 0.bpo-35673: Improve the introspectability of the
__loader__
attribute for namespace packages.importlib.machinery.NamespaceLoader
is now public, and implements theimportlib.abc.InspectLoader
interface._NamespaceLoader
is kept for backward compatibility.bpo-45515: Add references to
zoneinfo
in thedatetime
documentation, mostly replacing outdated references todateutil.tz
. Change by Paul Ganssle.bpo-45475: Reverted optimization of iterating
gzip.GzipFile
,bz2.BZ2File
, andlzma.LZMAFile
(see bpo-43787) because it caused regression when user iterate them without having reference of them. Patch by Inada Naoki.bpo-45489: Update
ForwardRef
to support|
operator. Patch by Donghee Na.bpo-42222: Removed deprecated support for float arguments in randrange().
bpo-45428: Fix a regression in py_compile when reading filenames from standard input.
bpo-45467: Fix incremental decoder and stream reader in the "raw-unicode-escape" codec. Previously they failed if the escape sequence was split.
bpo-45461: Fix incremental decoder and stream reader in the "unicode-escape" codec. Previously they failed if the escape sequence was split.
bpo-45239: Fixed
email.utils.parsedate_tz()
crashing withUnboundLocalError
on certain invalid input instead of returningNone
. Patch by Ben Hoyt.bpo-45417: Fix quadratic behaviour in the enum module: Creation of enum classes with a lot of entries was quadratic.
bpo-45249: Fix the behaviour of
traceback.print_exc()
when displaying the caret when theend_offset
in the exception is set to 0. Patch by Pablo Galindobpo-45416: Fix use of
asyncio.Condition
with explicitasyncio.Lock
objects, which was a regression due to removal of explicit loop arguments. Patch by Joongi Kim.bpo-20028: Empty escapechar/quotechar is not allowed when initializing
csv.Dialect
. Patch by Vajrasky Kok and Donghee Na.bpo-44904: Fix bug in the
doctest
module that caused it to fail if a docstring included an example with aclassmethod
property
. Patch by Alex Waygood.bpo-45406: Make
inspect.getmodule()
catchFileNotFoundError
raised byinspect.getabsfile()
, and returnNone
to indicate that the module could not be determined.bpo-45411: Add extensions for files containing subtitles - .srt & .vtt - to the mimetypes.py module.
bpo-10716: Migrated pydoc to HTML5 (without changing the look of it). Side effect is to update xmlrpc's
ServerHTMLDoc
which now uses the CSS too. cgitb now relies less on pydoc (as it can't use the CSS file).bpo-45262: Prevent use-after-free in asyncio. Make sure the cached running loop holder gets cleared on dealloc to prevent use-after-free in get_running_loop
bpo-45386: Make
xmlrpc.client
more robust to C runtimes where the underlying Cstrftime
function results in aValueError
when testing for year formatting options.bpo-20028: Improve error message of
csv.Dialect
when initializing. Patch by Vajrasky Kok and Donghee Na.bpo-45343: Update bundled pip to 21.2.4 and setuptools to 58.1.0
bpo-45328: Fixed
http.client.HTTPConnection
to work properly in OSs that don't support theTCP_NODELAY
socket option.bpo-45243: Add
setlimit()
andgetlimit()
tosqlite3.Connection
for setting and getting SQLite limits by connection basis. Patch by Erlend E. Aasland.bpo-45320: Removed from the
inspect
module:- the
getargspec
function, deprecated since Python 3.0; use
inspect.signature()
orinspect.getfullargspec()
instead.
- the
the
formatargspec
function, deprecated since Python 3.5; use theinspect.signature()
function andSignature
object directly.the undocumented
Signature.from_callable
andSignature.from_function
functions, deprecated since Python 3.5; use theSignature.from_callable()
method instead.
Patch by Hugo van Kemenade.
bpo-45192: Fix the
tempfile._infer_return_type
function so that thedir
argument of thetempfile
functions accepts an object implementing theos.PathLike
protocol.Patch by Kyungmin Lee.
bpo-45160: When tracing a tkinter variable used by a ttk OptionMenu, callbacks are no longer made twice.
bpo-25625: Added non parallel-safe
chdir()
context manager to change the current working directory and then restore it on exit. Simple wrapper aroundchdir()
.bpo-24139: Add support for SQLite extended result codes in
sqlite3.Error
. Patch by Erlend E. Aasland.bpo-24444: Fixed an error raised in
argparse
help display when help for an option is set to 1+ blank spaces or when choices arg is an empty container.bpo-44547: Implement
Fraction.__int__
, so that afractions.Fraction
instancef
passes anisinstance(f, typing.SupportsInt)
check.bpo-40321: Adds support for HTTP 308 redirects to
urllib
. See RFC 7538 for details. Patch by Jochem Schulenklopper.bpo-41374: Ensure that
socket.TCP_*
constants are exposed on Cygwin 3.1.6 and greater.bpo-35970: Add help flag to the base64 module's command line interface. Patch contributed by Robert Kuska.
Documentation¶
bpo-45726: Improve documentation for
functools.singledispatch()
andfunctools.singledispatchmethod
.bpo-45680: Amend the docs on
GenericAlias
objects to clarify that non-container classes can also implement__class_getitem__
. Patch contributed by Alex Waygood.bpo-45618: Update Sphinx version used to build the documentation to 4.2.0. Patch by Maciej Olko.
bpo-45655: Add a new "relevant PEPs" section to the top of the documentation for the
typing
module. Patch by Alex Waygood.bpo-45604: Add
level
argument tomultiprocessing.log_to_stderr
function docs.bpo-45516: Add protocol description to the
importlib.abc.TraversableResources
documentation.bpo-45464: Mention in the documentation of Built-in Exceptions that inheriting from multiple exception types in a single subclass is not recommended due to possible memory layout incompatibility.
bpo-45449: Add note about PEP 585 in
collections.abc
.bpo-45516: Add protocol description to the
importlib.abc.Traversable
documentation.bpo-20692: Add Programming FAQ entry explaining that int literal attribute access requires either a space after or parentheses around the literal.
Tests¶
bpo-45678: Add tests for scenarios in which
functools.singledispatchmethod
is stacked on top of a method that has already been wrapped by two other decorators. Patch by Alex Waygood.bpo-45578: Add tests for
dis.distb()
bpo-45678: Add tests to ensure that
functools.singledispatchmethod
correctly wraps the attributes of the target function.bpo-45668: PGO tests now pass when Python is built without test extension modules.
bpo-45577: Add subtests for all
pickle
protocols intest_zoneinfo
.bpo-45566: Fix
test_frozen_pickle
intest_dataclasses
to check allpickle
versions.bpo-43592:
test.libregrtest
now raises the soft resource limit for the maximum number of file descriptors when the default is too low for our test suite as was often the case on macOS.bpo-39679: Add more test cases for
@functools.singledispatchmethod
when combined with@classmethod
or@staticmethod
.bpo-45410: When libregrtest spawns a worker process, stderr is now written into stdout to keep messages order. Use a single pipe for stdout and stderr, rather than two pipes. Previously, messages were out of order which made analysis of buildbot logs harder Patch by Victor Stinner.
bpo-45402: Fix test_tools.test_sundry() when Python is built out of tree: fix how the freeze_modules.py tool locates the _freeze_module program. Patch by Victor Stinner.
bpo-45403: Fix test_sys.test_stdlib_dir() when Python is built outside the source tree: compare normalized paths. Patch by Victor Stinner.
bpo-45400: Fix test_name_error_suggestions_do_not_trigger_for_too_many_locals() of test_exceptions if a directory name contains "a1" (like "Python-3.11.0a1"): use a stricter regular expression. Patch by Victor Stinner.
bpo-10572: Rename
sqlite3
tests fromtest_sqlite
totest_sqlite3
, and relocate them toLib/test/test_sqlite3
. Patch by Erlend E. Aasland.
Build¶
bpo-43158:
setup.py
now uses values from configure script to build the_uuid
extension module. Configure now detects util-linux'slibuuid
, too.bpo-45666: Fix warning of
swprintf
and%s
usage in_testembed.c
bpo-45548:
Modules/Setup
andModules/makesetup
have been improved. TheSetup
file now contains working rules for all extensions. Outdated comments have been removed. Rules defined bymakesetup
track dependencies correctly.bpo-45548: The
math
andcmath
implementation now require a C99 compatiblelibm
and no longer ship with workarounds for missing acosh, asinh, atanh, expm1, and log1p functions.bpo-45595:
setup.py
andmakesetup
now track build dependencies on all Python header files and module specific header files.bpo-45571:
Modules/Setup
now usePY_CFLAGS_NODIST
instead ofPY_CFLAGS
to compile shared modules.bpo-45570:
pyexpat
and_elementtree
no longer define obsolete macrosHAVE_EXPAT_CONFIG_H
andUSE_PYEXPAT_CAPI
.XML_POOR_ENTROPY
is now defined inexpat_config.h
.bpo-43974:
setup.py
no longer definesPy_BUILD_CORE_MODULE
. Instead every module, that uses the internal API, defines the macro.bpo-45548: Fill in missing entries in Modules/Setup.
bpo-45532: Update
sys.version
to usemain
as fallback information. Patch by Jeong YunWon.bpo-45536: The
configure
script now checks whether OpenSSL headers and libraries provide required APIs. Most common APIs are verified. The check detects outdated or missing OpenSSL. Failures do not stop configure.bpo-45221: Fixed regression in handling of
LDFLAGS
andCPPFLAGS
options whereargparse.parse_known_args()
could interpret an option as one of the built-in command line argument, for example-h
for help.bpo-45440: Building Python now requires a C99
<math.h>
header file providing the following functions:copysign()
,hypot()
,isfinite()
,isinf()
,isnan()
,round()
. Patch by Victor Stinner.bpo-45405: Prevent
internal configure error
when runningconfigure
with recent versions of non-Apple clang. Patch by David Bohman.bpo-45433: Avoid linking libpython with libcrypt.
Windows¶
bpo-43652: Update Tcl/Tk to 8.6.11, actually this time. The previous update incorrectly included 8.6.10.
bpo-45337: venv now warns when the created environment may need to be accessed at a different path, due to redirections, links or junctions. It also now correctly installs or upgrades components when the alternate path is required.
bpo-43851: Build SQLite
SQLITE_OMIT_AUTOINIT
on Windows. Patch by Erlend E. Aasland.
macOS¶
bpo-44828: Avoid tkinter file dialog failure on macOS 12 Monterey when using the Tk 8.6.11 provided by python.org macOS installers. Patch by Marc Culler of the Tk project.
IDLE¶
bpo-45495: Add context keywords 'case' and 'match' to completions list.
C API¶
bpo-29103:
PyType_FromSpec*
now copies the class name from the spec to a buffer owned by the class, so the original can be safely deallocated. Patch by Petr Viktorin.bpo-45522: The internal freelists for frame, float, list, dict, async generators, and context objects can now be disabled.
bpo-35134: Exclude
PyWeakref_GET_OBJECT()
from the limited C API. It never worked since thePyWeakReference
structure is opaque in the limited C API.bpo-35081: Move the
interpreteridobject.h
header file fromInclude/
toInclude/internal/
. It only provides private functions. Patch by Victor Stinner.bpo-35134: The non-limited API files
cellobject.h
,classobject.h
,context.h
,funcobject.h
,genobject.h
andlongintrepr.h
have been moved to theInclude/cpython
directory. Moreover, theeval.h
header file was removed. These files must not be included directly, as they are already included inPython.h
: Include Files. If they have been included directly, consider includingPython.h
instead. Patch by Victor Stinner.bpo-45474: The following items are no longer available when
Py_LIMITED_API
is defined:the
Py_MARSHAL_VERSION
macro
These are not part of the limited API.
Patch by Victor Stinner.
bpo-45434: Remove the
pystrhex.h
header file. It only contains private functions. C extensions should only include the main<Python.h>
header file. Patch by Victor Stinner.bpo-45440: Remove the
Py_FORCE_DOUBLE()
macro. It was used by thePy_IS_INFINITY()
macro. Patch by Victor Stinner.bpo-45434:
<Python.h>
no longer includes the header files<stdlib.h>
,<stdio.h>
,<errno.h>
and<string.h>
when thePy_LIMITED_API
macro is set to0x030b0000
(Python 3.11) or higher. C extensions should explicitly include the header files after#include <Python.h>
. Patch by Victor Stinner.bpo-41123: Remove
Py_UNICODE_COPY()
andPy_UNICODE_FILL()
macros, deprecated since Python 3.3. UsePyUnicode_CopyCharacters()
ormemcpy()
(wchar_t*
string), andPyUnicode_Fill()
functions instead. Patch by Victor Stinner.bpo-45412: Remove the following math macros using the
errno
variable:Py_ADJUST_ERANGE1()
Py_ADJUST_ERANGE2()
Py_OVERFLOWED()
Py_SET_ERANGE_IF_OVERFLOW()
Py_SET_ERRNO_ON_MATH_ERROR()
Patch by Victor Stinner.
bpo-45395: Custom frozen modules (the array set to
PyImport_FrozenModules
) are now treated as additions, rather than replacing all the default frozen modules. Frozen stdlib modules can still be disabled by setting the "code" field of the custom array entry to NULL.bpo-43760: Add new
PyThreadState_EnterTracing()
, andPyThreadState_LeaveTracing()
functions to the limited C API to suspend and resume tracing and profiling. Patch by Victor Stinner.bpo-44220:
PyStructSequence_UnnamedField
is added to the Stable ABI.
Python 3.11.0 alpha 1¶
Release date: 2021-10-05
Security¶
bpo-42278: Replaced usage of
tempfile.mktemp()
withTemporaryDirectory
to avoid a potential race condition.bpo-44600: Fix incorrect line numbers while tracing some failed patterns in match statements. Patch by Charles Burkland.
bpo-41180: Add auditing events to the
marshal
module, and stop raisingcode.__init__
events for every unmarshalled code object. Directly instantiated code objects will continue to raise an event, and audit event handlers should inspect or collect the raw marshal data. This reduces a significant performance overhead when loading from.pyc
files.bpo-44394: Update the vendored copy of libexpat to 2.4.1 (from 2.2.8) to get the fix for the CVE-2013-0340 "Billion Laughs" vulnerability. This copy is most used on Windows and macOS.
bpo-43124: Made the internal
putcmd
function insmtplib
sanitize input for presence of\r
and\n
characters to avoid (unlikely) command injection.bpo-44022:
http.client
now avoids infinitely reading potential HTTP headers after a100 Continue
status response from the server.
Core and Builtins¶
bpo-43760: The number of hardware branches per instruction dispatch is reduced from two to one by adding a special instruction for tracing. Patch by Mark Shannon.
bpo-45061: Add a deallocator to the bool type to detect refcount bugs in C extensions which call Py_DECREF(Py_True) or Py_DECREF(Py_False) by mistake. Detect also refcount bugs when the empty tuple singleton or the Unicode empty string singleton is destroyed by mistake. Patch by Victor Stinner.
bpo-24076: sum() was further optimised for summing up single digit integers.
bpo-45190: Update Unicode databases to Unicode 14.0.0.
bpo-45167: Fix deepcopying of
types.GenericAlias
objects.bpo-45155:
int.to_bytes()
andint.from_bytes()
now take a default value of"big"
for thebyteorder
argument.int.to_bytes()
also takes a default value of1
for thelength
argument.bpo-44219: Release the GIL while performing
isatty
system calls on arbitrary file descriptors. In particular, this affectsos.isatty()
,os.device_encoding()
andio.TextIOWrapper
. By extension,io.open()
in text mode is also affected. This change solves a deadlock inos.isatty()
. Patch by Vincent Michel in bpo-44219.bpo-44959: Added fallback to extension modules with '.sl' suffix on HP-UX
bpo-45121: Fix issue where
Protocol.__init__
raisesRecursionError
when it's called directly or viasuper()
. Patch provided by Yurii Karabas.bpo-44348: The deallocator function of the
BaseException
type now uses the trashcan mechanism to prevent stack overflow. For example, when aRecursionError
instance is raised, it can be linked to another RecursionError through the__context__
attribute or the__traceback__
attribute, and then a chain of exceptions is created. When the chain is destroyed, nested deallocator function calls can crash with a stack overflow if the chain is too long compared to the available stack memory. Patch by Victor Stinner.bpo-45123: Fix PyAiter_Check to only check for the __anext__ presence (not for __aiter__). Rename PyAiter_Check to PyAIter_Check, PyObject_GetAiter -> PyObject_GetAIter.
bpo-1514420: Interpreter no longer attempts to open files with names in angle brackets (like "<string>" or "<stdin>") when formatting an exception.
bpo-41031: Match C and Python code formatting of unprintable exceptions and exceptions in the
__main__
module.bpo-37330:
open()
,io.open()
,codecs.open()
andfileinput.FileInput
no longer accept'U'
("universal newline") in the file mode. This flag was deprecated since Python 3.3. Patch by Victor Stinner.bpo-45083: When the interpreter renders an exception, its name now has a complete qualname. Previously only the class name was concatenated to the module name, which sometimes resulted in an incorrect full name being displayed.
(This issue impacted only the C code exception rendering, the
traceback
module was using qualname already).bpo-34561: List sorting now uses the merge-ordering strategy from Munro and Wild's
powersort()
. Unlike the former strategy, this is provably near-optimal in the entropy of the distribution of run lengths. Most uses oflist.sort()
probably won't see a significant time difference, but may see significant improvements in cases where the former strategy was exceptionally poor. However, as these are all fast linear-time approximations to a problem that's inherently at best quadratic-time to solve truly optimally, it's also possible to contrive cases where the former strategy did better.bpo-45056: Compiler now removes trailing unused constants from co_consts.
bpo-45020: Add a new command line option, "-X frozen_modules=[on|off]" to opt out of (or into) using optional frozen modules. This defaults to "on" (or "off" if it's running out of the source tree).
bpo-45012: In
posix
, release GIL duringstat()
,lstat()
, andfstatat()
syscalls made byos.DirEntry.stat()
. Patch by Stanisław Skonieczny.bpo-45018: Fixed pickling of range iterators that iterated for over
2**32
times.bpo-45000: A
SyntaxError
is now raised when trying to delete__debug__
. Patch by Donghee Na.bpo-44963: Implement
send()
andthrow()
methods foranext_awaitable
objects. Patch by Pablo Galindo.bpo-44962: Fix a race in WeakKeyDictionary, WeakValueDictionary and WeakSet when two threads attempt to commit the last pending removal. This fixes asyncio.create_task and fixes a data loss in asyncio.run where shutdown_asyncgens is not run
bpo-24234: Implement the
__bytes__()
special method on thebytes
type, so a bytes objectb
passes anisinstance(b, typing.SupportsBytes)
check.bpo-24234: Implement the
__complex__()
special method on thecomplex
type, so a complex numberz
passes anisinstance(z, typing.SupportsComplex)
check.bpo-44954: Fixed a corner case bug where the result of
float.fromhex('0x.8p-1074')
was rounded the wrong way.bpo-44947: Refine the syntax error for trailing commas in import statements. Patch by Pablo Galindo.
bpo-44945: Specialize the BINARY_ADD instruction using the PEP 659 machinery. Adds five new instructions:
BINARY_ADD_ADAPTIVE
BINARY_ADD_FLOAT
BINARY_ADD_INT
BINARY_ADD_UNICODE
BINARY_ADD_UNICODE_INPLACE_FAST
bpo-44929: Fix some edge cases of
enum.Flag
string representation in the REPL. Patch by Pablo Galindo.bpo-44914: Class version tags are no longer recycled.
This means that a version tag serves as a unique identifier for the state of a class. We rely on this for effective specialization of the LOAD_ATTR and other instructions.
bpo-44698: Restore behaviour of complex exponentiation with integer-valued exponent of type
float
orcomplex
.bpo-44895: A debug variable
PYTHONDUMPREFSFILE
is added for creating a dump file which is generated by--with-trace-refs
. Patch by Donghee Na.bpo-44900: Add five superinstructions for PEP 659 quickening:
LOAD_FAST LOAD_FAST
STORE_FAST LOAD_FAST
LOAD_FAST LOAD_CONST
LOAD_CONST LOAD_FAST
STORE_FAST STORE_FAST
bpo-44889: Initial implementation of adaptive specialization of
LOAD_METHOD
. The following specialized forms were added:LOAD_METHOD_CACHED
LOAD_METHOD_MODULE
LOAD_METHOD_CLASS
bpo-44890: Specialization stats are always collected in debug builds.
bpo-44885: Correct the ast locations of f-strings with format specs and repeated expressions. Patch by Pablo Galindo
bpo-44878: Remove the loop from the bytecode interpreter. All instructions end with a DISPATCH macro, so the loop is now redundant.
bpo-44878: Remove switch statement for interpreter loop when using computed gotos. This makes sure that we only have one dispatch table in the interpreter.
bpo-44874: Deprecate the old trashcan macros (
Py_TRASHCAN_SAFE_BEGIN
/Py_TRASHCAN_SAFE_END
). They should be replaced by the new macrosPy_TRASHCAN_BEGIN
andPy_TRASHCAN_END
.bpo-44872: Use new trashcan macros (Py_TRASHCAN_BEGIN/END) in frameobject.c instead of the old ones (Py_TRASHCAN_SAFE_BEGIN/END).
bpo-33930: Fix segmentation fault with deep recursion when cleaning method objects. Patch by Augusto Goulart and Pablo Galindo.
bpo-25782: Fix bug where
PyErr_SetObject
hangs when the current exception has a cycle in its context chain.bpo-44856: Fix reference leaks in the error paths of
update_bases()
and__build_class__
. Patch by Pablo Galindo.bpo-44826: Initial implementation of adaptive specialization of STORE_ATTR
Three specialized forms of STORE_ATTR are added:
STORE_ATTR_SLOT
STORE_ATTR_SPLIT_KEYS
STORE_ATTR_WITH_HINT
bpo-44838: Fixed a bug that was causing the parser to raise an incorrect custom
SyntaxError
for invalid 'if' expressions. Patch by Pablo Galindo.bpo-44821: Create instance dictionaries (__dict__) eagerly, to improve regularity of object layout and assist specialization.
bpo-44792: Improve syntax errors for if expressions. Patch by Miguel Brito
bpo-34013: Generalize the invalid legacy statement custom error message (like the one generated when "print" is called without parentheses) to include more generic expressions. Patch by Pablo Galindo
bpo-44732: Rename
types.Union
totypes.UnionType
.bpo-44725: Expose specialization stats in python via
_opcode.get_specialization_stats()
.bpo-44717: Improve AttributeError on circular imports of submodules.
bpo-44698: Fix undefined behaviour in complex object exponentiation.
bpo-44653: Support
typing
types in parameter substitution in the union type.bpo-44676: Add ability to serialise
types.Union
objects. Patch provided by Yurii Karabas.bpo-44633: Parameter substitution of the union type with wrong types now raises
TypeError
instead of returning