cubicweb/devtools/httptest.py
author Julien Cristau <julien.cristau@logilab.fr>
Wed, 24 Feb 2016 17:31:56 +0100
changeset 11158 669eac69ea21
parent 11057 0b59724cb3f2
child 11160 ed048bfd1b88
permissions -rw-r--r--
[devtools] add CubicWebWsgiTC Similar to CubicWebServerTC, except using wsgiref instead of twisted as an http server.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
10235
684215aca046 Remove remote repository-access-through-pyro support
Aurelien Campeas <aurelien.campeas@logilab.fr>
parents: 9929
diff changeset
     1
# copyright 2003-2014 LOGILAB S.A. (Paris, FRANCE), all rights reserved.
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
     2
# contact http://www.logilab.fr/ -- mailto:contact@logilab.fr
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
     3
#
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
     4
# This file is part of CubicWeb.
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
     5
#
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
     6
# CubicWeb is free software: you can redistribute it and/or modify it under the
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
     7
# terms of the GNU Lesser General Public License as published by the Free
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
     8
# Software Foundation, either version 2.1 of the License, or (at your option)
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
     9
# any later version.
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    10
#
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    11
# CubicWeb is distributed in the hope that it will be useful, but WITHOUT
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    12
# ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    13
# FOR A PARTICULAR PURPOSE.  See the GNU Lesser General Public License for more
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    14
# details.
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    15
#
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    16
# You should have received a copy of the GNU Lesser General Public License along
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    17
# with CubicWeb.  If not, see <http://www.gnu.org/licenses/>.
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    18
"""this module contains base classes and utilities for integration with running
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    19
http server
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    20
"""
10589
7c23b7de2b8d [py3k] print function
Samuel Trégouët <samuel.tregouet@logilab.fr>
parents: 10363
diff changeset
    21
from __future__ import print_function
7c23b7de2b8d [py3k] print function
Samuel Trégouët <samuel.tregouet@logilab.fr>
parents: 10363
diff changeset
    22
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    23
__docformat__ = "restructuredtext en"
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    24
9136
eef0388e8fea [devtool] randomise available ports search in http test
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents: 8941
diff changeset
    25
import random
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    26
import threading
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    27
import socket
10603
65ad6980976e [py3k] import URL mangling functions using six.moves
Rémi Cardona <remi.cardona@logilab.fr>
parents: 10589
diff changeset
    28
10609
e2d8e81bfe68 [py3k] import range using six.moves
Rémi Cardona <remi.cardona@logilab.fr>
parents: 10604
diff changeset
    29
from six.moves import range, http_client
10603
65ad6980976e [py3k] import URL mangling functions using six.moves
Rémi Cardona <remi.cardona@logilab.fr>
parents: 10589
diff changeset
    30
from six.moves.urllib.parse import urlparse
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    31
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    32
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    33
from cubicweb.devtools.testlib import CubicWebTC
6424
f443a2b8a5c7 [devtools] refactor http server initialization in a much saner way
Julien Jehannet <julien.jehannet@logilab.fr>
parents: 6322
diff changeset
    34
from cubicweb.devtools import ApptestConfiguration
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    35
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    36
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    37
def get_available_port(ports_scan):
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    38
    """return the first available port from the given ports range
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    39
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    40
    Try to connect port by looking for refused connection (111) or transport
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    41
    endpoint already connected (106) errors
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    42
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    43
    Raise a RuntimeError if no port can be found
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    44
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    45
    :type ports_range: list
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    46
    :param ports_range: range of ports to test
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    47
    :rtype: int
6424
f443a2b8a5c7 [devtools] refactor http server initialization in a much saner way
Julien Jehannet <julien.jehannet@logilab.fr>
parents: 6322
diff changeset
    48
f443a2b8a5c7 [devtools] refactor http server initialization in a much saner way
Julien Jehannet <julien.jehannet@logilab.fr>
parents: 6322
diff changeset
    49
    .. see:: :func:`test.test_support.bind_port`
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    50
    """
9136
eef0388e8fea [devtool] randomise available ports search in http test
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents: 8941
diff changeset
    51
    ports_scan = list(ports_scan)
eef0388e8fea [devtool] randomise available ports search in http test
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents: 8941
diff changeset
    52
    random.shuffle(ports_scan)  # lower the chance of race condition
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    53
    for port in ports_scan:
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    54
        try:
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    55
            s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    56
            sock = s.connect(("localhost", port))
8695
358d8bed9626 [toward-py3k] rewrite to "except AnException as exc:" (part of #2711624)
Nicolas Chauvat <nicolas.chauvat@logilab.fr>
parents: 8694
diff changeset
    57
        except socket.error as err:
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    58
            if err.args[0] in (111, 106):
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    59
                return port
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    60
        finally:
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    61
            s.close()
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    62
    raise RuntimeError('get_available_port([ports_range]) cannot find an available port')
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    63
6322
711e7e8c69e3 [windmill] initialize windmill registry if not already existing (possible error case in dev)
Julien Jehannet <julien.jehannet@logilab.fr>
parents: 6315
diff changeset
    64
11158
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
    65
class _CubicWebServerTC(CubicWebTC):
11015
baf463175505 [devtools] Fix database creation issues for CubicWebServerTC tests
Rémi Cardona <remi.cardona@logilab.fr>
parents: 11014
diff changeset
    66
    """Class for running a Twisted-based test web server.
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    67
    """
6424
f443a2b8a5c7 [devtools] refactor http server initialization in a much saner way
Julien Jehannet <julien.jehannet@logilab.fr>
parents: 6322
diff changeset
    68
    ports_range = range(7000, 8000)
f443a2b8a5c7 [devtools] refactor http server initialization in a much saner way
Julien Jehannet <julien.jehannet@logilab.fr>
parents: 6322
diff changeset
    69
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    70
    def start_server(self):
11158
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
    71
        raise NotImplementedError
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    72
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    73
    def stop_server(self, timeout=15):
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    74
        """Stop the webserver, waiting for the thread to return"""
11158
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
    75
        raise NotImplementedError
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    76
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    77
    def web_login(self, user=None, passwd=None):
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    78
        """Log the current http session for the provided credential
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    79
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    80
        If no user is provided, admin connection are used.
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    81
        """
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    82
        if user is None:
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    83
            user  = self.admlogin
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    84
            passwd = self.admpassword
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    85
        if passwd is None:
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    86
            passwd = user
7434
17ef6f9efaa1 [test] fix tests broken by 7427:5338d895b891
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents: 7075
diff changeset
    87
        response = self.web_get("login?__login=%s&__password=%s" %
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    88
                                (user, passwd))
10604
d4bf85db41f2 [py3k] import HTTP client constants and exceptions using six.moves
Rémi Cardona <remi.cardona@logilab.fr>
parents: 10603
diff changeset
    89
        assert response.status == http_client.SEE_OTHER, response.status
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    90
        self._ident_cookie = response.getheader('Set-Cookie')
6315
8ca3ee849bee [test] fix broken tests and minor cleanups
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents: 5700
diff changeset
    91
        assert self._ident_cookie
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    92
        return True
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    93
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    94
    def web_logout(self, user='admin', pwd=None):
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    95
        """Log out current http user"""
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    96
        if self._ident_cookie is not None:
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    97
            response = self.web_get('logout')
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    98
        self._ident_cookie = None
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
    99
8727
5bca35901e9b [devtools/httptest] fix syntax error introduced by ce5ae7b80d2c
Aurelien Campeas <aurelien.campeas@logilab.fr>
parents: 8712
diff changeset
   100
    def web_request(self, path='', method='GET', body=None, headers=None):
10604
d4bf85db41f2 [py3k] import HTTP client constants and exceptions using six.moves
Rémi Cardona <remi.cardona@logilab.fr>
parents: 10603
diff changeset
   101
        """Return an http_client.HTTPResponse object for the specified path
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   102
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   103
        Use available credential if available.
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   104
        """
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   105
        if headers is None:
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   106
            headers = {}
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   107
        if self._ident_cookie is not None:
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   108
            assert 'Cookie' not in headers
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   109
            headers['Cookie'] = self._ident_cookie
8712
ce5ae7b80d2c [devtools/httptest] allow sending other types of requests besides GET
Julien Cristau <julien.cristau@logilab.fr>
parents: 8695
diff changeset
   110
        self._web_test_cnx.request(method, '/' + path, headers=headers, body=body)
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   111
        response = self._web_test_cnx.getresponse()
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   112
        response.body = response.read() # to chain request
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   113
        response.read = lambda : response.body
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   114
        return response
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   115
8712
ce5ae7b80d2c [devtools/httptest] allow sending other types of requests besides GET
Julien Cristau <julien.cristau@logilab.fr>
parents: 8695
diff changeset
   116
    def web_get(self, path='', body=None, headers=None):
ce5ae7b80d2c [devtools/httptest] allow sending other types of requests besides GET
Julien Cristau <julien.cristau@logilab.fr>
parents: 8695
diff changeset
   117
        return self.web_request(path=path, body=body, headers=headers)
ce5ae7b80d2c [devtools/httptest] allow sending other types of requests besides GET
Julien Cristau <julien.cristau@logilab.fr>
parents: 8695
diff changeset
   118
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   119
    def setUp(self):
11158
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   120
        super(_CubicWebServerTC, self).setUp()
11015
baf463175505 [devtools] Fix database creation issues for CubicWebServerTC tests
Rémi Cardona <remi.cardona@logilab.fr>
parents: 11014
diff changeset
   121
        port = self.config['port'] or get_available_port(self.ports_range)
baf463175505 [devtools] Fix database creation issues for CubicWebServerTC tests
Rémi Cardona <remi.cardona@logilab.fr>
parents: 11014
diff changeset
   122
        self.config.global_set_option('port', port) # force rewrite here
baf463175505 [devtools] Fix database creation issues for CubicWebServerTC tests
Rémi Cardona <remi.cardona@logilab.fr>
parents: 11014
diff changeset
   123
        self.config.global_set_option('base-url', 'http://127.0.0.1:%d/' % port)
baf463175505 [devtools] Fix database creation issues for CubicWebServerTC tests
Rémi Cardona <remi.cardona@logilab.fr>
parents: 11014
diff changeset
   124
        # call load_configuration again to let the config reset its datadir_url
baf463175505 [devtools] Fix database creation issues for CubicWebServerTC tests
Rémi Cardona <remi.cardona@logilab.fr>
parents: 11014
diff changeset
   125
        self.config.load_configuration()
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   126
        self.start_server()
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   127
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   128
    def tearDown(self):
11158
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   129
        self.stop_server()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   130
        super(_CubicWebServerTC, self).tearDown()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   131
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   132
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   133
class CubicWebServerTC(_CubicWebServerTC):
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   134
    def start_server(self):
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   135
        from twisted.internet import reactor
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   136
        from cubicweb.etwist.server import run
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   137
        # use a semaphore to avoid starting test while the http server isn't
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   138
        # fully initilialized
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   139
        semaphore = threading.Semaphore(0)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   140
        def safe_run(*args, **kwargs):
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   141
            try:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   142
                run(*args, **kwargs)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   143
            finally:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   144
                semaphore.release()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   145
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   146
        reactor.addSystemEventTrigger('after', 'startup', semaphore.release)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   147
        t = threading.Thread(target=safe_run, name='cubicweb_test_web_server',
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   148
                args=(self.config, True), kwargs={'repo': self.repo})
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   149
        self.web_thread = t
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   150
        t.start()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   151
        semaphore.acquire()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   152
        if not self.web_thread.isAlive():
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   153
            # XXX race condition with actual thread death
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   154
            raise RuntimeError('Could not start the web server')
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   155
        #pre init utils connection
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   156
        parseurl = urlparse(self.config['base-url'])
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   157
        assert parseurl.port == self.config['port'], (self.config['base-url'], self.config['port'])
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   158
        self._web_test_cnx = http_client.HTTPConnection(parseurl.hostname,
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   159
                                                        parseurl.port)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   160
        self._ident_cookie = None
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   161
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   162
    def stop_server(self, timeout=15):
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   163
        """Stop the webserver, waiting for the thread to return"""
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   164
        from twisted.internet import reactor
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   165
        if self._web_test_cnx is None:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   166
            self.web_logout()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   167
            self._web_test_cnx.close()
5654
8bb34548be86 [web test] Add a CubicWebServerTC class to run test with a cw web serveur available.
Pierre-Yves David <pierre-yves.david@logilab.fr>
parents:
diff changeset
   168
        try:
11158
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   169
            reactor.stop()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   170
            self.web_thread.join(timeout)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   171
            assert not self.web_thread.isAlive()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   172
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   173
        finally:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   174
            reactor.__init__()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   175
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   176
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   177
class CubicWebWsgiTC(CubicWebServerTC):
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   178
    def start_server(self):
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   179
        from cubicweb.wsgi.handler import CubicWebWSGIApplication
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   180
        from wsgiref import simple_server
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   181
        from six.moves import queue
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   182
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   183
        config = self.config
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   184
        port = config['port'] or 8080
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   185
        interface = config['interface']
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   186
        handler_cls = simple_server.WSGIRequestHandler
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   187
        app = CubicWebWSGIApplication(config)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   188
        start_flag = queue.Queue()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   189
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   190
        def run(config, *args, **kwargs):
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   191
            try:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   192
                self.httpd = simple_server.WSGIServer((interface, port), handler_cls)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   193
                self.httpd.set_app(app)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   194
            except Exception as exc:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   195
                start_flag.put(False)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   196
                start_flag.put(exc)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   197
                raise
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   198
            else:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   199
                start_flag.put(True)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   200
            try:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   201
                self.httpd.serve_forever()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   202
            finally:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   203
                self.httpd.server_close()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   204
        t = threading.Thread(target=run, name='cubicweb_test_web_server',
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   205
                             args=(self.config, True), kwargs={'repo': self.repo})
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   206
        self.web_thread = t
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   207
        t.start()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   208
        flag = start_flag.get()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   209
        if not flag:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   210
            t.join()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   211
            self.fail(start_flag.get())
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   212
        parseurl = urlparse(self.config['base-url'])
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   213
        assert parseurl.port == self.config['port'], (self.config['base-url'], self.config['port'])
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   214
        self._web_test_cnx = http_client.HTTPConnection(parseurl.hostname,
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   215
                                                        parseurl.port)
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   216
        self._ident_cookie = None
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   217
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   218
    def stop_server(self, timeout=15):
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   219
        if self._web_test_cnx is None:
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   220
            self.web_logout()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   221
            self._web_test_cnx.close()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   222
        self.httpd.shutdown()
669eac69ea21 [devtools] add CubicWebWsgiTC
Julien Cristau <julien.cristau@logilab.fr>
parents: 11057
diff changeset
   223
        self.web_thread.join(timeout)