Project

General

Profile

Debugging CiviCRM cheatsheet » History » Version 39

Jon Goldberg, 12/07/2023 09:27 PM

1 7 Jon Goldberg
{{last_updated_at}} by {{last_updated_by}}
2
3 1 Jon Goldberg
# Debugging CiviCRM cheatsheet
4
5
### Command-line runs of PHPUnit:
6
7
From a buildkit civiroot, run a specific file's tests::
8
9 2 Jon Goldberg
```shell
10
CIVICRM_UF=UnitTests phpunit5 tests/phpunit/CRM/Core/BAO/AddressTest.php
11
```
12 1 Jon Goldberg
13
You can also limit to a single test by filtering on name:
14
15 2 Jon Goldberg
```shell
16
CIVICRM_UF=UnitTests phpunit5 tests/phpunit/CRM/Core/BAO/AddressTest.php --filter testShared
17
```
18 3 Jon Goldberg
19
### With XDebug
20 9 Jon Goldberg
21 14 Jon Goldberg
#### Web Browser
22 37 Brienne Kordis
* Install the xdebug extension (e.g. `sudo apt install php8.1-xdebug`).
23
* Configure xdebug by copying the values below to `/etc/php/8.1/fpm/conf.d/xdebug.ini`:
24 2 Jon Goldberg
25 1 Jon Goldberg
```
26 12 Jon Goldberg
xdebug.mode=debug,develop
27
xdebug.start_with_request=trigger
28 1 Jon Goldberg
xdebug.client_port=9000
29
xdebug.client_host = "127.0.0.1"
30 10 Jon Goldberg
xdebug.log=/var/log/xdebug.log
31 12 Jon Goldberg
#xdebug.mode=profile
32 1 Jon Goldberg
#xdebug.output_dir = "/home/jon/temp/xdebug"
33
```
34 14 Jon Goldberg
35 1 Jon Goldberg
* Install a plugin for your browser, like "XDebug Helper for Firefox".
36 14 Jon Goldberg
 * In the plugin's configuration, set the IDE key to `VSCODE`.
37 37 Brienne Kordis
* For buildkit sites, you'll need to cp the `xdebug.ini` into `apache2/fpm/conf.d` and `cli/fpm/conf.8`. Then restart apache and php
38 14 Jon Goldberg
39 22 Brienne Kordis
* If one does not already exist, create a launch.json file within the .vscode folder (make a new folder if it does not yet exist) at the root of your codebase. What goes into the launch.json file depends on whether you are debugging a a site created with the `civibuild` command or one that was not built with that command. Here are examples of a [civibuild launch.json](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_civibuild_sites) and a [non-civibuild launch.json](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_non-civibuild_sites). Note that the "max-depth" on the "Listen for XDebug" configuration can be changed to delve deeper into the values that are returned (i.e. a depth of 6 will return more levels of a nested array than a depth of 3).
40 19 Brienne Kordis
41 14 Jon Goldberg
To debug, you must turn on the debugger in VS Code, then enable debugging in the address bar for the requests in question.
42
43 28 Jon Goldberg
#### Web Browser - remote debugging
44
To debug on a remote server, ensure you have local debugging working first.
45
46
#### Server-side setup
47
* `sudo apt install php{{php_version}}-xdebug` (I should add this to `group_vars/all.yml` so it's everywhere).
48 39 Jon Goldberg
* Create a file `/etc/php/{{php_version}}/fpm/conf.d/xdebug.ini:
49 28 Jon Goldberg
50
```
51
xdebug.mode=debug
52
xdebug.start_with_request=trigger
53
```
54
* Restart PHP.
55
56
#### Client side setup
57
* In your VS Code plugins screen, you need to select `Install in SSH` for the `PHP Debug` and `PHP Intelephense` plugins.
58
* Using the new **Remote Explorer** sidebar icon in VS Code, select the server you'd like to connect to.
59
* If you've already debugged on this site before, you should be able to expand the server and see a workspace file (see screenshot below).  Click one of the connect icons.
60
* If you haven't debugged on this site before, follow *First Time* instructions below. Otherwise, debug as normal (make sure your Firefox "debug" icon is turned on).
61
62
##### First Time
63
* Click **Open Folder** and navigate to the site's gitroot (usually the same as webroot, but for D8+ it's the folder above `web` so you can also debug in `vendor`).
64
* Select **File menu » Save Workspace As** and store a workspace file in your home directory.
65 29 Jon Goldberg
* Go to your **Extensions** sidebar, search for **php** and click **Install in SSH** next to *PHP Debug* and *PHP Intelephense*.
66
 * For Drupal sites, also **Install in SSH** the *Drupal Syntax Highlighting* extension or you can't debug .module files.
67
* Go to the VS Code "debug" sidebar.  Click **create a launch.json file** and then select **workspace**, then **PHP**.
68 28 Jon Goldberg
* (Optional) in the **Remote Explorer** sidebar, under the server you're connected to, right-click the entry that doesn't say "Workspace" in it and select **Remove from Recent List** to only keep workspace entries.
69
70 18 Jon Goldberg
#### civicrm-buildkit (mod_php)
71
The instructions above assume php-fpm.  To also debug mod_php (e.g. civicrm-buildkit), do the following:
72
* Use the same configuration file as under "Web Browser", but at `/etc/php/7.4/apache2/conf.d/xdebug.ini`.
73
* Edit `/etc/php/7.4/apache2/conf.d/xdebug.ini` and change the client port from `9000` to `9001`.
74
75 14 Jon Goldberg
#### Command Line (phpunit)
76
77 1 Jon Goldberg
* You need to have XDebug otherwise configured for CLI.  Use the same configuration file as under "Web Browser", but at `/etc/php/7.4/cli/conf.d/xdebug.ini`.
78 15 Jon Goldberg
 * Also change `xdebug.mode=debug,develop` to avoid some unnecessary warning noise.
79 14 Jon Goldberg
80 5 Jon Goldberg
* You need to start a debugging session in VS Code with "Listen for XDebug".
81 1 Jon Goldberg
* Depending on your VS Code setup, you may need to listen on a different port (I can use the same port for FPM but not mod_php).
82 2 Jon Goldberg
83
Once you've got all that:
84 1 Jon Goldberg
```shell
85 15 Jon Goldberg
env CIVICRM_UF=UnitTests XDEBUG_SESSION=VSCODE phpunit7 /home/jon/local/civicrm-buildkit/build/dmaster/web/sites/all/modules/civicrm/tests/phpunit/CRM/Core/BAO/ActionScheduleTest.php --filter testMembershipJoinDateMinutesUnit
86 2 Jon Goldberg
```
87 6 Jon Goldberg
88 30 Jon Goldberg
#### phpunit for extensions:
89
This is for core extensions, I'll figure out (again) non-core extensions later.  But from your civiroot:
90
```shell
91
CIVICRM_UF=UnitTests phpunit8 --bootstrap ext/afform/mock/tests/phpunit/bootstrap.php ext/afform/mock/tests/phpunit/api/v4/AfformContactUsageTest.php 
92
```
93
94 31 Jon Goldberg
For non-core extensions, from the extension's root folder. Note the use of `env XDEBUG_SESSION=VSCODE` for step debugging, and `--filter` to limit the tests run.
95
```
96
env XDEBUG_SESSION=VSCODE CIVICRM_UF=UnitTests phpunit8 --bootstrap tests/phpunit/bootstrap.php tests/phpunit/api/v3/Cdntaxreceipts/GenerateTest.php --filter testGenerate
97
```
98
99 8 Jon Goldberg
### Command-line runs of standalone scripts
100 6 Jon Goldberg
```shell
101 13 Jon Goldberg
env XDEBUG_SESSION=VSCODE php myscript.php
102 6 Jon Goldberg
```
103 38 Jon Goldberg
Also works for `cv`, probably `drush` and `wp` too:
104
```shell
105
env XDEBUG_SESSION=VSCODE cv api NotificationLog.retry system_log_id=147597 
106
```
107 16 Jon Goldberg
108
### Debugging REST API calls in Ansible/curl
109 17 Jon Goldberg
Add an additional POST argument `XDEBUG_SESSION=VSCODE`.  In curl, just add `-d 'XDEBUG_SESSION=VSCODE'` anywhere in your command.
110
111
For Ansible, this might look like:
112 16 Jon Goldberg
113
```yaml
114
  - name: Shut up about Civi extensions (warnings only, 7 days)
115
    uri:
116
      url: "{{ primary_url }}/{{ endpoint }}"
117
      method: POST
118
      body:
119
        XDEBUG_SESSION: VSCODE
120
        entity: StatusPreference
121
        action: create
122
        json: "{{ {'name': 'checkExtensionsUpdates', 'ignore_severity': 3, 'hush_until': seven_days_hence } | to_json }}"
123
        api_key: "{{ crm_api_key }}"
124
        key: "{{ crm_site_key }}"
125
      body_format: form-urlencoded
126
      return_content: yes
127
```
128 23 Jon Goldberg
129
### Debugging in PHP `file_get_contents()` (e.g. `check_civicrm.php`)
130
Add `XDEBUG_SESSION=VSCODE` as a `GET` argument, it works even on a `POST` request. Pairs well with a remote debugging session.
131
e.g.:
132
```php
133
$url = "$prot://$host_address/$path/System/check?XDEBUG_SESSION=VSCODE";
134
```
135 24 Brienne Kordis
136
### Debugging JavaScript
137
138
While you can open up the Developer Tools on a browser  (by right clicking on the window and then clicking **Inspect**) and debug the code directly there, it might be preferable to set up a debugging environment within an IDE, i.e. Visual Studio Code.  To do so:
139
140 27 Brienne Kordis
1. Open up your launch.json file (Need to set one up? There are [non-civibuild](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_non-civibuild_sites) and [Civibuild](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_civibuild_sites) options)
141 24 Brienne Kordis
1. Within the  `”configurations:”` array, add a comma after the last curly brace and then paste in:
142
143
``` json
144
    {
145
      "type": "msedge",
146
      "request": "attach",
147
      "name": "Attach to browser",
148
      "port": 9222
149
    }
150
```
151
   * If you’d prefer to debug on chrome, use `”type”: “chrome”`
152
1. Within your terminal, run the following command:
153
154
```bash
155 26 Brienne Kordis
/usr/bin/google-chrome --remote-debugging-port=9222 –user-data-dir=remote-debug-profile
156 24 Brienne Kordis
```
157
  * `/usr/bin/google-chrome` is the path of the Google Chrome Binary on Linux. For other operating systems, check out this [comment](https://forum.katalon.com/t/unknown-error-cannot-find-chrome-binary/9008/5), but note that the exact name might be different (i.e. google-chrome1 vs google-chrome). You can always `cd`  through the path it recommends to find the exact match for either Chrome or MSEdge.
158
159
1. Within VS Code, go to the Run and Debug tab, and from the drop down menu at the top, select “Attach to browser” and start the debugger. 
160
   * Note that the command given in the previous step is configured to open up a new browser, but these arguments (and more) can be customized. See the [documentation](https://code.visualstudio.com/docs/nodejs/browser-debugging#_launch-configuration-attributes)
161
162
1. The new browser window (or tab, depending on your settings) is now configured to be the debuggee-yes, that’s the technical term- so you can set breakpoints and debug within VS Code!
163 32 Jon Goldberg
164
### Running Drupal 9+ tests
165
The [Mink setup](https://docs.civicrm.org/dev/en/latest/testing/mink/) instructions worked quite well.
166
I then also ran:
167
```
168
composer require drupal/webform
169
composer require drupal/webform_civicrm
170 33 Jon Goldberg
composer require drupal/token
171 32 Jon Goldberg
composer require semperit/minkcivicrmhelpers
172
```
173 33 Jon Goldberg
174
Looking at CiviCARROT logs on the Webform-CiviCRM Github was helpful to figure those out.
175 34 Jon Goldberg
176
For permissions reasons, you have to run as the www-data user (this is set up with `mod_php`, not `php-fpm`):
177
```shell
178
zabuntu: ~/local/wfc-testing/web/core » sudo -u www-data ../../vendor/bin/phpunit -c ../../phpunit.xml ../modules/contrib/webform_civicrm/tests/src/FunctionalJavascript/ContributionPayLaterTest.php --filter testSubmitContribution
179
```
180 35 Brienne Kordis
181
### Finding an entry point to debug 
182
If a better one can't be found in an error log/message, use these steps to start debugging:
183
1. ssh into the server
184
1. change to root user
185
1. `cd /var/log/apache2`
186 36 Brienne Kordis
1. `nano other_vhosts_access.log`
187 35 Brienne Kordis
1. search for your IP address ( you can type "What's my IP address?" into Google if you don't know it)
188
1. find the relevant line(s) with your IP address and grab the civicrm path from the url
189
1. open up mysql (`cv sql`) and run `select * from civicrm_menu where path = '[civicrm path]';`
190 36 Brienne Kordis
1. look at the access arguments, but we care most about the `page_callback` column which lists the civicrm class that is loaded at that path
191 35 Brienne Kordis
1. open up that class in the codebase and use the buildForm hook as the entry point for debugging